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(54) Terminal apparatus and method for achieving interactive operations 



(57) A terminal apparatus is provided for displaying 
an image by reproducing a piece of image information 
and for interactively changing the image using naviga- 
tion information. The image is a moving picture, a still 
picture, or a mixture of them. The image information and 
the navigation information together are broadcast by a 
broadcasting station to the terminal apparatus. The nav- 
igation information indicates a plurality pieces of link- 
target image information. The cache unit stores a pair 
of image information and navigation information. The re- 
producing unit reproduces the image information. The 
monitoring unit monitors whether an operator has per- 
formed a certain operation responding to the image dis- 
played. The receiving unit, before the operator performs 
the certain operation, receives a plurality pieces of im- 
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age information which have possibility of being dis- 
played and a plurality pieces of correspondinq naviqa- 
tion information based on the navigation information, 
and stores the plurality pieces of image information and 
navigation information in the cache unit. The specifying 
unit specifies a piece of link-target image information 
based on the certain operation. The identifying unit iden- 
tifies the piece of link-target image information as a 
piece of image information. The first controlling unit 
reads the piece of link-target image information and in- 
structs the reproducing unit to reproduce the piece of 
link-target image information, and instructs the receiving 
unit to receive other plurality pieces of image information 
and navigation information based on a piece of naviga- 
tion information corresponding to the link-target image 
information identified by the identifying unit. 
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Description 

BACKGROUND OF THE INVENTION 

(1) Field of the Invention 5 

This invention relates to a terminal apparatus used 
in communication services such as digital satellite 
broadcasting and digital CATV (Community Antenna 
Television), and to a method used for the terminal ap- to 
paratus. 

(2) Description of the Prior Art 

As the number of channels provided in the satellite is 
broadcasting or CATV has increased greatly, competi- 
tion among broadcasting companies has been intensi- 
fied. Broadcasting companies hope that broadcasting 
systems known as interactive TV broadcasting systems 
will attract many viewers, and active studies into inter- 20 
active TV broadcasting systems are under way. The 
term "interactive" indicates that the user can display de- 
sired images by making requests. Suppose, for exam- 
ple, each screen includes a plurality of icons which are 
related to other pieces of image information which form 25 
screens. It is supposed that in the interactive TV broad- 
casting system, a desired piece of image information is 
displayed when the operator selects an icon on the in- 
teractive screen. The operator feels as if he/she could 
display what he/she desired. Such an interactive TV 30 
broadcasting system is epoch-making in TV broadcast- 
ing where one-way broadcasting has long been the 
norm. There is a possibility that the interactive TV broad- 
casting system will become a next-generation standard 
for TV broadcasting system. 35 

Such an interactive TV broadcasting system may 
be achieved by a method in which each terminal appa- 
ratus sends a request for transmitting a desired piece of 
image information to the broadcasting station, and in re- 
sponse, the broadcasting station transmits the desired 40 
piece of image information to the terminal apparatuse. 
For achieving this, the broadcasting station needs to 
store a large amount of image information which can be 
provided to the terminal apparatuses. 

It is increasingly difficult to achieve the above sys- 45 
tern as the number of terminal apparatuses increases. 
This is because a number of communication lines need 
tobeprovidedfortransferring the transmission requests 
and image information. Such a construction may also 
surfer from an overflow in handling the transmission re- so 
quests in the broadcasting station due to an overflow in 
the communication lines which are used for transferring 
the read requests and image information. Viewers may 
stop using such an interactive TV broadcasting system 
if it takes very long to display a desired image. ss 



SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide a terminal apparatus and a method used therein 
for immediately displaying a desired piece of image in- 
formation in an interactive broadcasting system upon re- 
quest of the operator, where a large number of terminal 
apparatuses receive broadcasts in the interactive 
broadcasting system. 

The above object is achieved by a terminal appara- 
tus for displaying an image by reproducing one out of m 
pieces of image information and for interactively chang- 
ing the image using n pieces of navigation information, 
where the image is one of a moving picture, a still pic- 
ture, and a mixture of a moving picture and a still picture, 
where the m pieces of image information and the n piec- 
es of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, where 
each piece of navigation" information is related to an or- 
igin piece of image information and indicates a plurality 
pieces of link-target image information, where m and n 
are each an integer either of being equal to and larger 
than "V the terminal apparatus including: a cache unit 
for storing a pair of one out of the m pieces of image 
information and one out of the n pieces of navigation 
information; reproducing unit for reproducing the one 
out of the m pieces of image information stored in the 
cache unit: monitoring unit for monitoring whether an op- 
erator has performed a certain operation responding to 
the image displayed; a receiving unit for, before the 
monitoring unit determines that the operator has per- 
formed the certain operation, receiving s pieces of im- 
age information which have possibility of being dis- 
played and t pieces of navigation information respec- 
tively related to the s pieces of image information based 
on the one out of the n pieces of navigation information 
stored in the cache unit, and storing the s pieces of im- 
age information and the t pieces of navigation informa- 
tion in the cache unit, where s is an integer satisfying 
1^s<m : and t is an integer satisfying 1st<n; a specify- 
ing unit for specifying one out of the plurality pieces of 
link-target image information based on the certain oper- 
ation when the monitoring unit monitors that the opera- 
tor has performed the certain operation; an identifying 
unit for identifying the one out of the plurality pieces of 
link-target image information specified by the specifying 
unit as one out the s pieces of image information stored 
in the cache unit; and a first controlling unit for reading 
the piece of link-target image information identified by 
the identifying unit and instructing the reproducing unit 
to reproduce the piece of link-target image information, 
and instructing the receiving unit to receive other s piec- 
es of image information and other t pieces of navigation 
information based on one out of the t pieces of naviga- 
tion information in the cache unit corresponding to the 
piece of link-target image information identified by the 
identifying unit. 

With such a construction, a desired piece of image 
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information is immediately displayed. The current 
screen is changed to the next screen at high speed upon 
request of the operator since while the current screen is 
displayed, a plurality pieces of link-target image infor- 
mation and corresponding pieces of navigation informa- s 
tion are stored in the cache unit. The above screen 
change is also performed using the waiting time of the 
terminal apparatus for a period during which the opera- 
tor determines an icon on the screen. 

The above terminal apparatus may further include: 10 
a superimposing unit for superimposing, based on a 
piece of navigation information corresponding to the one 
out of the m pieces of image information stored in the 
cache unit, a plurality of icons on the image which is 
displayed when the reproducing unit reproduces the one is 
out of the m pieces of image information, where the 
monitoring unit includes: a determination operation de- 
tecting unit for detecting a determination operation per- 
formed on one out of the plurality of icons, where the 
identifying unit identifies one out of the plurality pieces 20 
of link-target image information detected by the deter- 
mination operation detecting unit. 

With such a construction, a visual interactive oper- 
ation is achieved since a plurality of icons, which indi- 
cate link-target pieces of image information, are super- 25 
imposed on the screen image. 

In the above terminal apparatus, the reproducing 
unit may include: a focus setting unit for making one out 
of the plurality of icons be in focus, where the monitoring 
unit includes: a cursor move operation detecting unit for 30 
detecting a cursor move operation: and a focus chang- 
ing unit for making another one out of the plurality of 
icons be in focus based on the cursor move operation 
detected by the cursor move operation detecting unit, 
where the determination operation detecting unit de- 35 
tects a determination operation performed on the other 
one out of the plurality of icons in focus. 

With such a construction, the cursor (icon in focus) 
is moved based on the interactive operation. This ena- 
bles cursor moves with the use of cross keys. 40 

The above terminal apparatus may further include: 
a rank setting unit for setting ranks of the m pieces of 
image information stored in the cache unit based on 
possibility of being displayed; and a cache table regis- 
tering unit for registering identifiers of high ranking s 45 
pieces of image information in a cache table, out of the 
m pieces of image information and registering identifiers 
of t pieces of navigation information corresponding to 
the high ranking s pieces of image information, where 
the receiving unit receives the s pieces of image infor- so 
mation whose identifiers are registered by the cache ta- 
ble registering unit and receives t pieces of navigation 
information corresponding to the s pieces of image in- 
formation. 

With such a construction, a certain number of piec- ss 
es of image information having possibility of being dis- 
played are stored in the cache unit. Therefore, these 
pieces of image information and corresponding naviga- 
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tion information are displayed with high probability. 

The above terminal apparatus may further include: 
a weighting unit for weighting, with a highest value, the 
one out of the plurality of icons made to be in focus by 
the focus setting unit, and for weighting, with a second 
highest value, icons adjacent to the one in focus, where 
the rank setting unit sets ranks of the m pieces of image 
information based on values weighted by the weighting 
unit. 

With such a construction, information related to the 
icon in focus and the adjacent icons is stored in the 
cache unit. Therefore, these pieces of image informa- 
tion and corresponding navigation information are dis- 
played with high probability. 

The above terminal apparatus may further include: 
a statistics value storing unit for storing a statistics value 
for each piece of image information which indicates a 
number of times the piece of image information has 
been determined, where the rank setting unit sets ranks 
of the m pieces of image information based on the sta- 
tistics value for each piece of image information. 

With such a construction, the possibility of being 
displayed is evaluated based on the statistics values. 
Therefore, these pieces of image information and cor- 
responding navigation information are displayed with 
high probability. 

The above terminal apparatus may further include: 
a rank information detecting unit for detecting a piece of 
rank information from the piece of navigation informa- 
tion corresponding to the one out of the m pieces of im- 
age information reproduced by the reproducing unit, 
where the piece of rank information includes ranks of 
the plurality pieces of link-target image information, 
where the rank setting unit sets ranks of the m pieces 
of image information based on the piece of rank infor- 
mation. 

With such a construction, the possibility of being 
displayed is evaluated based on the rank included in 
each piece of navigation information. Therefore, these 
pieces of image information and corresponding naviga- 
tion information are displayed with high probability. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other objects, advantages and features 
of the invention will become apparent from the following 
description thereof taken in conjunction with the accom- 
panying drawings which illustrate a specific embodi- 
ment of the invention. In the drawings: 

FIG.1 A shows a pictorial view of a satellite broad- 
casting system; 

FIG.1 B shows the construction of the transport 
stream which is divided into a number of transport 
packets; 

FIG.2A shows the first frame of video element[1] 
and a corresponding voice in audio element[1 ], both 
included in presentation stream[1]; 
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FIG.2B shows the first frame of video element[2] 

and a corresponding voice in audio element[2], both 

included in presentation stream[2]; 

FIG.2C shows the first frame of video etement[l2] 

and a corresponding voice in audio element[12], 

both included in presentation streamfl 2]; 

FIG.2D shows the first frame of video element[43] 

and a corresponding voice in audio element[43), 

both included in presentation stream[43]; 

FIG.3 shows the content of NVT[1]; 

FIG. 4 shows the content of NVT[2]; 

FIG.5 shows the content of NVT[12]; 

FIG.6 shows the content of PMT; 

FIG.7 shows a tree structure formed with NVTs and 

"contents;" 

Fl G. 8 A shows an appearance of the viewing system 
for satellite broadcasting; 

FIG.8B shows the front panel of handy remote con- 
troller 4; 

FIG.9 shows the construction of terminal apparatus 
2; 

FIGs.10A-10G show contents of navigation cache 
unit 14; 

FIGs.11 A-11G show contents of presentation cache 
unit 15; 

FIG. 12 shows a statistics table stored in statistics 
table storing unit 18; 

FIG.13A shows a cache table which is generated 

based on the statistics table: 

FIG.13B shows a cache table which is generated 

based on the "rank" column in the hyperlink table; 

FIG.13C shows a cache table which is generated 

based on the icon currently in focus; 

FIG. 14 shows the main flowchart of the operation 

of cache manager 17; 

FIG. 15 shows the flowchart of cache manager 17 

in reading contents in advance; 

FIG. 16 shows the flowchart of cache manager 17 

in generating the cache table; 

FIG. 17 shows the flowchart of cache manager 17 

in reading contents in advance; 

FIG. 18 shows the main flowchart of the operation 

of browser 25; 

FIG.1 9 the flowchart of browser 25 in switching in- 
teractive screens; 

FIG. 20 the flowchart of browser 25 in switching in- 
teractive screens; 

FIG. 21 the flowchart of browser 25 in switching in- 
teractive screens; 

FIG.22A shows an interactive screen which is an 
image generated from presentation stream[1] with 
the icons of NVT[1] superimposed on the image; 
FIG.22B shows an interactive screen which is an 
image generated from presentation stream[2] with 
the icons of NVT[2] superimposed on the image; 
FIG.22C shows an interactive screen which is an 
image generated from presentation stream[12] with 
the icons of NVT[12] superimposed on the image; 



FIG.22D shows an interactive screen which is an 
image generated from presentation stream[43] with 
the icons of NVT[43] superimposed on the image; 
FIG. 23 shows the contents of the transport streams 
5 including still pictures; 

FIG.24A shows the content of VET[15]; 
FIG.24B shows the content of VETJ16]; and 
FIG. 25 shows a content of the hyperlink table. 

70 DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

<First Embodiment 

15 To achieve an interactive TV broadcasting system 
connected to a large number of terminal apparatuses 
set in a number of households, it is not ideal to allow the 
terminal apparatuses to send requests for transmitting 
images. The present embodiment achieves an interac- 
ts tive TV broadcasting system in which requests for trans- 
mitting images are not sent from the terminal appara- 
tuses. In the present embodiment, a TV broadcasting 
station sends a plurality of images to a plurality of ter- 
minal apparatuses so that the terminal apparatuses 
^ each can interactively select and receive a desired im- 
age. 

In such a broadcasting system, the interactivity is 
achieved by one-way image transmission since it is not 
necessary for the terminal apparatuses to send image 

30 transmission requests to the TV broadcasting station. 
On the other hand, the TV broadcasting station is re- 
quired to send quite a large number of images to the 
terminal apparatuses since it must send all the neces- 
sary images for achieving the interactivity. When this 

?s happens, that is, when the number of sent images in- 
creases, the time taken to receive and display the im- 
ages also increases. 

FIG.1 A shows a pictorial view of a satellite broad- 
casting system described in the present embodiment. 

to As shown in this drawing, broadcasting station 100 
transmits a broadcasting wave to broadcasting satellite 
200, as indicated by dotted line hi . Broadcasting satel- 
lite 200 sends this broadcasting wave to a wide region 
on the earth, as indicated by dotted lines h2, h3, h4, and 

( £ h5, so that terminal apparatuses in this region receive 
the broadcasting wave. Broadcasting station 100 and 
broadcasting satellite 200 repeat such transmissions in 
a unit cycle of several minutes. This enables a large 
number of terminal apparatuses in the region to receive 

; o the broadcasting wave. 

The broadcasting wave mentioned above is a car- 
rier wave which has been modulated from transport 
streams with the QPSK (Quadrature Phase Shift Key- 
ing) method. 

5 Each of the transport streams is composed of vari- 
ous types of data, or multiple data. The transport stream 
is defined in detail in MPEG (Motion Picture Experts 
Group). A transport stream is composed of a large 
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number of transport packets. The transport packet is 
used for transmitting data and is the smallest unit of data 
whose transmission is assured. Each transport packet 
includes an error detection code and an error correction 
code. 

F1G.1B shows the construction of the transport 
stream. The transport stream is represented by a hori- 
zontally-long rectangle in the upper part of the drawing, 
the transport stream being divided into a number of box- 
es representing transport packets. 

The lower part of FIG.1B shows a plurality of sub- 
streams of the transport stream. The sub-streams are: 
a video elementary stream which is composed of video 
elements (represented each as " VE" in the drawing), an 
video elementary stream which is composed of audio 
elements (represented each as "AE" in the drawing), a 
navigation information table (NVT) sub-stream which is 
composed of NVTs (represented each as "NVT" in the 
drawing), a program clock reference (PCR) table sub- 
stream (represented each as "PCR" in the drawing) for 
synchronizing the video elements with the audio ele- 
ments, a program association table (PAT) sub-stream 
which is composed of PATs (represented each as "PAT" 
in the drawing), a program map table (PMT) sub-stream 
which is composed of PMTs (represented each as 
"PMT" in the drawing), a network information table (NIT) 
sub-stream which is composed of NITs (represented 
each as "NIT" in the drawing) for indicating which satel- 
lite is used to relay the transport packets, that is, for in- 
dicating to which network the transport packets belong, 
a service description table sub-stream (represented as 
"SDT" in the drawing) for indicating which program is 
broadcast by the transport packets, that is, for indicating 
to which service the transport packets belong, and an 
event information table (EIT) sub-stream which is com- 
posed of EITs (represented each as M EIT" in the draw- 
ing) for indicating to which channel, namely to which 
event, the transport packets belong. For more informa- 
tion on the above sub-streams, refer to ETS 300 468 
standard (DVB-SI standard) and ISO/IEC 13818-1 
(MPEG2 system standard). 

As described above, transport streams, each in- 
cluding various types of data as shown in FIG.1B, are 
transmitted. 

Each transport packet : which belongs to a video el- 
ement or an audio element, includes a packet identifier 
(PID) which indicates to which element the transport 
packet belongs. 

A plurality of video elements, audio elements, and 
PCRs make up a presentation stream which corre- 
sponds to one scene in a film. 

VE[1], VE [2], VE[12], VE[43] ... in FIG. IB include 
their own PIDs. For example, VE[1] includes PID 
n 0x202; n VE[2] includes PID °0x302. n 

FIGs.2A-2D show examples of audio elements and 
video elements making up a presentation stream. 

Presentation stream[1] includes audio element[1] 
with PID "0x601 " and videoelement[1 ] with PID "0x202. tt 
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FIG.2A shows a scene which is obtained by decoding 
video element[1]. In this scene, an announcer of a 
broadcasting company makes an introductory speech 
for about two-minutes. The video element[1] is accom- 
5 panied by audio element[1] which includes a narration: 
INTRODUCING INTERACTIVE CHANNEL. THANK 
YOU FOR SELECTING THE 'A' BROADCAST FOR 
TODAY'S BROADCAST, WE WILL BE SHOWING THE 
FOLLOWING PROGRAMS. WE ARE SURE YOU WILL 
io ENJOY THEM." 

Presentation stream[2] includes audio element[2] 
with PI D "0x602 tt and video element[2] with PI D "0x302. " 
FIG.2B shows a scene which is displayed by decoding 
video element[2]. The scene provides a preview of films 
is to be released soon. The video element[2] is accompa- 
nied by audio element[2] which includes a narration: 
"NEW MOVIE INFORMATION. COMING UP SOON AT 
THEATERS IN OSAKA." 

FIGs.2C and 2D respectively show the content of 
20 presentation streams[12] and [43]. Presentation 
streams[1 2] and [43] respectively include the shots and 
narrations shown in the drawings. 

The M NVT fl is important as a private section under 
ISO/IEC 13818-1 standard. Each private section can 
2S additionally include a "tablejd.extension" which is 
called a table identifier. Each of NVTs[0], [1], [2], and 
[12] shown in FIG. IB, for example, includes a common 
PID, w 0x0082." NVT [0] also includes table identifier 
"OxOOOO." NVT[1] includes table identifier "0x0001 , M 
30 NVT[2] table identifier "0x0002," and NVT[12] table 
identifier "0x0012." That means, a video element or an 
audio element identifies itself with a PID; an NVT iden- 
tifies itself with a table identifier 

Now, the navigation information table (NVT) is de- 
36 scribed. 

The NVT includes navigation information which is 
used for displaying icons on the screen and moving the 
icons based on interactive operations made with the op- 
erator. The icons in the present embodiment are any of 

40 patterns, characters, and colors, or combinations of 
these elements. The icons are used to inform the oper- 
ator of the content of information, and is used as option 
items. A representative method of indicating a selected 
icon is a cursor display. The cursor display described 

is here is a different color of one icon than the other icons 
displayed on the screen. This is an effective way for 
drawing the attention of the operator to the icon. The 
icon with the different color is also called an icon in fo- 
cus. That means, as the cursor moves, the color of the 

50 icon also changes. 

Now, the data structure of the NVT is described with 
reference to FIGs.3, 4, and 5. 

FIG. 3 shows the content of NVT[1] shown in FIG. 
1B. FIG. 4 shows the content of NVT[2] shown in FIG. 

55 1B. FIG. 5 shows the content of NVT[12] shown in FIG. 
1 B. Each NVT is composed of bit map table 301 , object 
definition table 302, handler definition table 303, and hy- 
perlink table 304. Each piece of information in each table 
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is related to each other. For example, a piece of infor- 
mation with index number 1 in the object definition table 
302 is related to a piece of information with HDJndex 
number 1 in the handler definition table 303 as indicated 
by the HANDLER column, and further to a piece of in- s 
formation with HLJndex number 1 in the hyperlink table 
304 as indicated by the "script* column. Such pieces of 
information in the NVT related to each other make up a 
piece of navigation information. 

Bit map table 301 of NVT[1] shown in FIG. 3 is com- 10 
posed of bitmap 1 used as an icon indicating "NEW 
MOVIE IN FORMATION , n bitmap 2 as an icon indicating 
"INTERNET LATEST INFORMATION," bitmap 3 as an 
icon indicating "EVENT INFORMATION, 0 bitmap 4 as 
an icon indicating "PROGRAM PREVIEW,* and bitmaps is 
101 -104 which are copies of bitmaps 1-4 and are high- 
lighted. 

The bit map table of NVT[2] shown in FIG. 4 is com- 
posed of bitmap 5 used as an icon indicating "THE TER- 
ROR OF THE HUGE TORNADO (DISTRIBUTED BY 20 
AAA COMPANY), n "THE RETURN OF THE MON- 
STROUS DINOSAURS (DISTRIBUTED BY BBB COM- 
PANY), n "SPORTS WARS (DISTRIBUTED BY AAA 
COMPANY)," and "RETURN," and bitmaps 105-108 
which are copies of bitmaps 5-8 and are highlighted. 25 

While each of the bitmap tables of NVT[1] and NVT 
[2] includes four pieces of bitmap information some bit- 
map tables include as many as 10 pieces of bitmap in- 
formation. NVT[12] shown in FIG. 5 provides an example 
of such a bitmap table. 30 

Object definition table 302 is composed of a plurality 
pieces of object definition information which is used to 
define the icons included in the same NVT as objects. 
The object definition table 302 includes columns called 
"index," "type," D X-coordinate, B "Y-coordinate," "HAN- 3S 
DLER,° "normal bitmap," and "focused J>itmap." 

The "index" column shows the index number of 
each piece of information included in the table. 

The "type" column shows the object type. For ex- 
ample, each piece of information in the object definition 40 
table is specified as "Button" in the type column, which 
indicates that the icon has a characteristic as a button. 

The values in the "X-coordinate" and "Y-coordinate" 
columns show the respective X and Y coordinates of the 
standard display position on the display screen. For ex- 45 
ample, X and Y coordinates of navigation information^] 
are respectively x1=50 and y1=50; X and Y coordinates 
of navigation information[2] are respectively x2=100 
and y2=50. The origin of the coordinate system is in the 
upper-left corner. Bitmap 1 representing the "NEW so 
MOVIE INFORMATION" icon is displayed at a position 
specified by x1=50 and y1=50, an upper-left position on 
the screen. Bitmap 2 representing the "INTERNET LAT- 
EST INFORMATION" icon is displayed at a position 
specified by x2=100 and y2=50, an upper-right position ss 
on the screen. 

The "HANDLER" column points out an HDJndex 
number in the handler definition table 303. The informa- 



tion with the HD index number includes a script as 
shown in the "script 0 column which shows a link-target 
"content" by the HL index number in the hyperlink table 
304, where a "content" is composed of a NVT, a video 
element, and an audio element. 

The "normaLbitmap" column shows bit maps 
among those included in the bit map table which are dis- 
played normally on the screen. 

The "focusedjDitmap" column shows bit maps 
among those included in the bit map table which are dis- 
played highlighted on the screen. 

The handler definition table 303 includes columns 
called "HDJndex" and "script." 

The "HDJndex" column shows the HDJndex 
number of each piece of information included in the ta- 
ble. 

The "script" column shows a script included in each 
piece of information included in the table. Every piece 
of information the handler definition table 303 shown in 
FIG. 3 includes "golo_content" statement. The 
"goto_content" statement instructs the terminal appara- 
tus to fetch a piece of hyperlink information specified in 
the statement from the hyperlink table 304 and to obtain 
an NVT, video element, and audio element according to 
the hyperlink information. 

The hyperlink table 304 includes a column called 
"HL index" and 11 columns which are information ele- 
ments used to identify the link-target content. This is be- 
cause detailed information is required to specify a link 
target content among the vast amount of information 
provided in the digital broadcasting system. 

The "HLJndex" column shows the HLJndex 
number of each piece of information included in the ta- 
ble. 

The n orig_nwJd" column shows which satellite is 
used to relay the link-target NVT, video element, and au- 
dio element. In other words, the n orig_nwJd n column 
shows to which network the link-target NVT, video ele- 
ment, and audio element belong. 

The "tsjd" column shows which transport stream 
is used to transfer the link-target content. 

The "VE_svcJd" column shows to which TV pro- 
gram (service) the link-target video element belongs 
among a plurality of TV programs included in the trans- 
port stream. 

The "VE_event_id" column shows to which broad- 
casting channel (event) the TV program of the link-target 
video element belongs. 

The "VE_compJag" column shows which compo- 
nent tag is attached to the link-target video element, 
where the component is a stream identified by a PID 
(packet identifier) as defined in the MPEG2 standard. In 
the present embodiment, a video element or an audio 
element may be a component since each of these ele- 
ment includes its own PID. In case a group of video el- 
ements or audio elements are assigned one PID, the 
group is regarded as one component. 

The "AE_svcJd" column shows to which TV pro- 
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gram (service) the link-target audio element belongs 
among a plurality of TV programs included in the trans- 
port packet. 

The u AE_event_id n column shows to which broad- 
casting channel (event) the TV program including of the s 
link-target audio element belongs. 

The "AE^omp^ag 1 ' column shows which compo- 
nent tag is attached to the link-target audio element. 

The "NE_svcJd" column shows to which TV pro- 
gram (service) the link-target NVT belongs among a plu- to 
rality of TV programs included in the transport stream. 

The "NE_eventJd p column shows to which broad- 
casting channel (event) the TV program of the link-target 
NVT belongs. 

The "NEJd_EXT" column shows which table iden- is 
titter ( w table_id_extension ,, ) is attached to the link-target 
NVT. 

The "rank" column shows a rank of the link-target 
video element, audio element, and NVT, the rank being 
determined by the broadcasting station according to the 20 
frequency of display or the like. In FIG. 3, for example, 
a piece of information in the hyperlink table 304 with 
HLJndex number 1 (hereinafter, represented as 
HL_index[1]) has the highest rank, "2," followed by 
HL_index[2], HLJndex [3] s and HLJndex [41. The rank 2s 
may be determined according to answers to question- 
naires distributed by the broadcasting company, or ac- 
cording to fashions or topics in recent years. 

FIG. 6 shows the content of the PMT (Program Map 
Table). The PMT includes columns called "PID," 30 
"streamjype," and "descriptor." 

The "PID" column shows PIDs (Packet IDentifiers). 

The "stream Jype" column shows a type of each 
stream. 

The "descriptor" column shows a stream descriptor 35 
"streamjdentifier_descriptor" including a component 
tag corresponding to each PID. For example, stream de- 
scriptor D stream_identifier_descriptor B including compo- 
nent tag "0x0002" is related to M PID0x0302. D Stream de- 
scriptor "stream identifier_descriptor M including compo- 
nent tag "0x0003" is related to "PIDOx0303." The PMT 
is required for the terminal apparatus to obtain a PID of 
a transport packet from a component tag of a link-target 
video element or a link-target audio element obtained 
from the hyperlink table. 45 

A link-target NVT, video element, or audio element 
is obtained as follows based on the hyperlink table in 
NVT and PMT. 

<Specifying Link-Target NVT> so 

The"HANDLER" column of the object definition ta- 
ble 302 in NVT specifies one HDJndex number of the 
handler definition table 303. By referring to the script for 
the obtained HD index number, one HLJndex number ss 
of the hyperlink table 304 is obtained. By referring to the 
"NEJd.EXT- column of the table 304, the table identi- 
fier attached to the link-target NVT is obtained. 



1-1 When bitmapl of NVT[1] related to the icon in- 
dicating "NEW MOVIE INFORMATION" is deter- 
mined: 

HLJndex "1" -> NEJd_EXT[Ox0002] -» NVT 
[2] including table identifier "0x0002" (refer to FIG. 
1 B for NVT[2] with the table identifier) 
1-2 When bitmap2 of NVTJ1] related to the icon in- 
dicating "INTERNET LATEST INFORMATION" is 
determined: 

HLJndex "2* -> NE Jd_EXT[Ox0003] -» NVT 
[3] including table identifier "0x0003" (refer to FIG. 
1B) 

1- 3 When bitmap3 of NVT[1] related to the icon in- 
dicating "EVENT INFORMATION" is determined: 

HLJndex "3" -» NE Jd_EXT[Ox0004] -» NVT 
[4] including table identifier "0x0004" (refer to FIG. 
1B) 

1 -4 When bitmap4 of NVT[1] related to the icon in- 
dicating "PROGRAM PREVIEW" is determined: 

HLJndex "4" -4 NEJd_EXT[0x0O05] -* NVT 
(5) including table identifier w 0x0005" (refer to FIG. 
1B) 

<Specifying Link-Target Video Element> 

The"HANDLER" column of the object definition ta- 
ble 302 in NVT specifies one HDJndex number of the 
handler definition table 303. By referring to the script for 
the obtained HD index number, one HLJndex number 
of the hyperlink table 304 is obtained. By referring to the 
"VE_comp_tag" column of the table 304, the component 
tag attached to the link-target video element is obtained. 
By referring to the "descriptor" column of the PMT, the 
PID attached to the link-target video element is ob- 
tained. 

2- 1 When bitmapl of NVT[1] related to the icon in- 
dicating "NEW MOVIE INFORMATION" is deter- 
mined: 

HLJndex "1" VE_comp_tag[0x0002] -» 
PID[0x0302] VE[2] (refer to FIG.1 B) 
2-2 When bitmap2 of NVT[1] related to the icon in- 
dicating "INTERNET LATEST INFORMATION" is 
determined: 

HLJndex "2" -» VE_comp_tag[0x0003] -> 
PID[0x0303] -> VE[3] (refer to FIG. IB) 
2-3 When bitmap3 of NVT[1] related to the icon in- 
dicating "EVENT INFORMATION" is determined: 

HLJndex3 -> VE_compJag[0x0004] PID 
[0x0304] -> VE[4] (refer to FIG.1 B) 
2-4 When bitmap4 of NVT[1] related to the icon in- 
dicating "PROGRAM PREVIEW" is determined: 

HLJndex4 -> VE_comp_tag[0x0005] -> PID 
[0x0305] VE[5] (refer to FIG.1 B) 

<Specifying Link-Target Audio Element> 

The"HANDLER" column of the object definition ta- 
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ble 302 in NVT specifies one HDJndex number of the 
handler definition table 303. By referring to the script for 
the obtained HD index number, one HLJndex number 
of the hyperlink table 304 is obtained. By referring to the 
n AE_comp_tag" column of the table 304, the component 
tag attached to the link-target audio element is obtained. 
By referring to the "descriptor" column of the PMT, the 
PID attached to the link-target audio element is ob- 
tained. 

2-1 When bitmapl of NVT[1] related to the icon in- 
dicating "NEW MOVIE INFORMATION" is deter- 
mined: 

HLJndex n 1 B -> AE_comp_tag[0x0102] 
PID[Ox0602] -» AE[2] (refer to FIG.1B) 
2-2 When bitmap2 of NVT[1 j related to the icon in- 
dicating "INTERNET LATEST INFORMATION" is 
determined: 

HLJndex "2" AE_compJag[0x0l03] -» 
PID[Ox0603]-> AE[3] (refer to FIG.1B) 
2-3 When bitmap3 of NVT[1] related to the icon in- 
dicating "EVENT INFORMATION" is determined: 

HLJndex3 -> AE_comp_tag[0x0104] -» PID 
[0x0604] -> AE[4] (refer to FIG.1 B) 
2-4 When bitmap4 of NVT[1] related to the icon in- 
dicating "PROGRAM PREVIEW" is determined: 

HLJndex4 AE_compJag[0x0105] -» PID 
[0x0605] -> AE[5] (refer to FIG.1 B) 

As will be understood from the above description, 
NVT[1] specifies NVT[2], VE[2], and AE[2] as the link- 
targets. Such a group of a NVT, a video element, and 
an audio element specified as link-targets are called a 
"content. " A link-target content is specified by an NVT. 
Then, another link-target is specified by the NVT of the 
content. In this way, NVT-content relation is constructed. 

FIG.7 shows a tree structure formed with NVTs and 
°contents n in the present embodiment. The plurality of ar- 
rows shown in the drawing indicate the direction of the 
links. Note that the root of the tree is called "root content. " 

FIG.7 indicates that content[1] includes VE[1], AE 
[1], and NVT[1J (in the drawing, VE[1] and AE[1] is rep- 
resented as "VE_AE[1]. U Hereinafter, a combination of 
VE and AE included in a content is represented as 
"VE^AE"). This indicates that when presentation stream 
[1 ) is decoded to generate a shot image, the bit maps of 
NVT[1] are superimposed on the shot image. 

Similarly, content[2] includes VE[2], AE[2], and NVT 
[2]. This indicates that when presentation stream[2] is 
decoded to generate an image of the preview of films, 
the bit maps of NVT[2] are superimposed on the image. 

A screen which is composed of an image generated 
from a presentation stream with icons superimposed on 
the image is called an interactive screen. FIGs.22A-22D 
show interactive screens. FIG.22A, for example, shows 
an interactive screen which is an image generated from 
presentation stream[1] with the icons of NVT[1] super- 
imposed on the image. 



The transport stream constructed as shown above 
is repeatedly transmitted from broadcasting station 100 
to the terminal apparatuses, as shown in FIG.1 A. Ac- 
cordingly, the terminal apparatuses can obtain neces- 
5 sary streams or tables. Note that the terminal appara- 
tuses must wait for each cycle period of the transmission 
for obtaining the necessary streams or tables. 

Now, a system for viewing programs which are 
broadcast with transport streams is described. FIG. 8 A 

io shows an appearance of the viewing system which is 
composed of parabolic antenna 1 , terminal apparatus 
2, TV receiver 3, and handy remote controller 4. 

Parabolic antenna 1 which is set outside a house is 
used to receive carrier waves of the transport streams 

*s transmitted by the broadcasting satellite. 

Terminal apparatus 2 fetches transport streams 
from the carrier waves received by parabolic antenna 1 , 
and decodes the transport streams to NTSC or PAL im- 
age signals and stereo audio signals (hereinafter, a 

20 combination of an image signal and an audio signal is 
called an AV signal). 

TV receiver 3 outputs images and voices according 
to the AV signals decoded by terminal apparatus 2. 
Handy remote controller 4, while TV receiver 3 out- 

25 puts images and voices, receives instructions from the 
operator and outputs infrared ray signals representing 
the received instructions to terminal apparatus 2. 

FIG.8B shows the keys arranged on handy remote 
controller 4. Handy remote controller 4 includes cross 

30 key 41 for moving the cursor, ten keys 42 for specifying 
numerals for selection, and enter key 43 for determining 
icons and the like. 

The construction of the terminal apparatus is de- 
scribed with reference to FIG. 9. The terminal apparatus 

35 is composed of demodulator 10, TS decoder 11 , AV de- 
coder 12, AV decoder controlling unit 13, navigation 
cache unit 14, presentation cache unit 15, operation de- 
tecting unit 16, cache manager 17, statistics table stor- 
ing unit 1 8, mode managing unit 1 9, cache table storing 

40 unit 20, cache processing unit 21, input switching unit 
22, graphic storing unit 23, graphic displaying unit 24, 
and browser 25. 

Demodulator 10 demodulates a carrier wave, which 
is sent from the broadcasting station and is received by 

45 the CS antenna, to obtain transport packets, and out- 
puts the obtained transport packets to TS decoder 1 1 . 

TS decoder 11 separates the transport packets 
which belong to the video elementary stream or the vid- 
eo elementary stream from those output by demodulator 

50 10, and outputs the separated transport packets to input 
switching unit 22 at the side of AV decoder 12. When a 
table identifier is specified from browser 25, TS decoder 
11 detects a transport packet which has the specified 
table identifier among the plurality of transport packets 

55 of the table sub-stream, and outputs the detected trans- 
port packet to cache processing unit 21 at the side of 
browser 25. 

AV decoder 1 2, when input switching unit 22 outputs 



BNSDOCID:<EP 0827340A2 I > 



8 



15 



EP 0 827 340 A2 



16 



a transport packet of video elementary stream or video 
elementary stream and a PID is specified by the AV de- 
coder controlling unit 1 3 t decodes the transport packet, 
the video element, and the audio element to generate 
an AV signal synchronizing them with PCR. In generat- 
ing the AV signal by decoding, when browser 25 outputs 
the bit maps included in an NVT and when AV decoder 
controlling unit 13 instructs AV decoder 12 to superim- 
pose the bit maps on the image, AV decoder 12 super- 
imposes the bit maps output from browser 25 onto the 
decoded image, and outputs the combined image to an 
AV terminal of the TV receiver as the AV signal. 

AV decoder controlling unit 13, when browser 25 
outputs a PID and an instruction for decoding the video 
element and audio element corresponding to the PID, 
instructs AV decoder 12 to decode the video element 
and the audio element by referring to the PID. When 
browser 25 outputs an instruction for superimposing the 
bit maps onto the image of the video element, AV de- 
coder controlling unit 13 instructs AV decoder 12 to su- 
perimpose the bit maps onto the image of the video el- 
ement. AV decoder controlling unit 13 also instructs AV 
decoder 1 2 to change the color of a part of the bit maps 
in display if browser 25 instructs so. 

Navigation cache unit 14, which include memories 
enabling high-speed access, stores, among a plurality 
of NVTs included in transport streams, every NVT which 
has bit maps that may be displayed and all the NVTs 
whose bit maps having been displayed. Navigation 
cache unit 14 includes storage areas for storing NVTs, 
the storage areas having sequence numbers 1 , 2, 3, 4, 
5, and 6 and display history marks for indicating whether 
the bit maps of the stored NVT are displayed (hit or 
missed). . 

FIG.10A shows the content of navigation cache unit 
14 when the interactive screen shown in FIG.22A is dis- 
played. As shown in FIG.22A, the interactive screen dis- 
plays icons indicating "NEW MOVIE I N FORM ATI ON 
"INTERNET LATEST INFORMATION," "EVENT IN- 
FORMATION," and "PROGRAM PREVIEW," waiting for 
the operator to input instructions for moving the cursor 
or for determining a selected icon. According to the con- 
tent of navigation cache unit 14, it is recognized that 
NVT[1] whose icons are currently displayed has a mark 
indicating a hit. The drawing also indicates that naviga- 
tion cache unit 14 has already stored NVT[2], NVT[3], 
NVT[4], and NVT[5]. Those NVTs are specified by the 
handler definition table 303 and hyper table 304 of NVT 
[1]. When the operator determines one out of the icons 
indicating "NEW MOVIE INFORMATION," "INTERNET 
LATEST INFORMATION," "EVENT INFORMATION," 
and "PROGRAM PREVIEW," the corresponding one out 
of NVTs[2]-[5] is displayed on the screen. 

As will be understood from the above description, 
navigation cache unit 14 stores NVT[2], NVT [3], NVT 
[4], and NVT[5] whose bit maps may be displayed next 
after the current screen shown in FIG.22A. 

FIG. 1 0D shows the content of navigation cache unit 



14 when the interactive screen shown in FIG.22B is dis- 
played. As shown in FIG.22B. the interactive screen dis- 
plays icons indicating "THE TERROR OF THE HUGE 
TORNADO (DISTRIBUTED BY AAA COMPANY)," 

5 "THE RETURN OF THE MONSTROUS DINOSAURS 
(DISTRIBUTED BY BBB COMPANY)," "SPORTS 
WARS (DISTRIBUTED BY AAA COMPANY)," and "RE- 
TURN," waiting for the operator to input instructions for 
moving the cursor or for determining a selection. Ac- 

10 cording to the content of navigation cache unit 14, it is 
recognized that NVT[1] whose bit maps having been 
displayed and NVT[2] whose bit maps are currently dis- 
played respectively have a mark indicating a hit. The 
drawing also indicates that navigation cache unit 1 4 has 

is already stored NVT[11], NVT[12], and NVT[21]. Those 
NVTs are specified by the handler definition table and 
hyper table of NVT[2]. That is, navigation cache unit 14 
stores NVT[11], NVT[12], and NVT[21] that may be dis- 
played next after the current screen shown in FIG.22B. 

20 FIG. 10G shows the content of navigation cache unit 
14 when the interactive screen shown in FIG.22C is dis- 
played. The interactive screen including the bit maps of 
NVT[12] is shown in FIG.22C. According to the content 
of navigation cache unit 14, it is recognized that NVT 

25 [1 2] whose bit maps are currently displayed has a mark 
indicating a hit. The drawing also indicates that naviga- 
tion cache unit 1 4 has already stored NVT[41 ], N VT[42], 
NVT[43], and NVT[44). NVTs [41]-[44] are specified by 
the handler definition table and hyper table of NVT[12]. 

30 That is, navigation cache unit 14 stores NVTs [41]-[44] 
that may be displayed next after the current screen 
shown in FIG.22C. 

Note that the procedure for storing the above NVTs 
in navigation cache unit 14, as shown in FIGs.lOA, 10D, 

35 and 10G, will be described later. 

Presentation cache unit 1 5 is a memory, as naviga- 
tion cache unit 1 4, enabling high-speed accesses. Pres- 
entation cache unit 15 stores, among a plurality of pres- 
entation streams included in transport streams, every 

^0 presentation stream which has a possibility of being dis- 
played and all the presentation streams having been 
displayed. Navigation cache unit 1 5 includes storage ar- 
eas for storing presentation streams, the storage areas 
having sequence numbers 1, 2, 3, 4, 5, and 6 and dis- 

45 play history marks for indicating whether each stored 
presentation stream is displayed (hit or missed). Each 
of the storage areas also has identification information 
indicating how image information is stored in the storage 
area, that is, whether the whole image is stored or 

50 whether only the first frame is stored. 

FIG. 11 A shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22A 
is displayed. According to the content of presentation 
cache unit 15, it is recognized that currently displayed 

55 presentation stream[1] has a mark indicating a hit. The 
drawing also indicates that presentation cache unit 15 
has already stored presentation stream[2], presentation 
stream[3], presentation stream[4], and presentation 
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stream[5] . Those presentation streams are specified by 
the handler definition table and hyper table of NVT[1], 
When the operator determines one out of icons indicat- 
ing "NEW MOVIE INFORMATION," "INTERNET LAT- 
EST INFORMATION," "EVENT INFORMATION," and s 
"PROGRAM PREVIEW," the corresponding one of 
presentation streams[2]-[5] is displayed on the screen. 

As will be understood from the above description, 
presentation stream cache unit 15 stores presentation 
stream[2], presentation stream[3], presentation stream 10 
[4], and presentation stream[5] that may be displayed 
next after the current screen shown in FIG.22A. 

FIG. 11 D shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22B 
is displayed. According to the content, it is recognized is 
that presentation stream[1] having been displayed and 
presentation stream[2] currently displayed respectively 
have a mark indicating a hit. The drawing also indicates 
that presentation cache unit 1 5 has already stored pres- 
entation stream[11], presentation stream[12], and pres- 20 
entation stream[21]. That is, presentation cache unit 15 
stores presentation stream[11], presentation stream 
[1 2], and presentation stream[2 1 ] that may be displayed 
next after the current screen shown in FIG.22B. Those 
presentation streams are specified by the handler defi- 25 
nition table and hyper table of NVT[2]. 

FIG. 11 G shows the content of presentation cache 
unit 15 when the interactive screen shown in FIG.22C 
is displayed. According to the content, it is recognized 
that presentation cache unit 1 5 has already stored pres- 30 
entation streams[41]-[44]. That is, presentation cache 
unit 15 stores presentation streams[41]-[44] that may be 
displayed next after the current screen shown in FIG. 
22C. Those presentation streams are specified by the 
handler definition table and hyper table of NVT[12]. 35 

Operation detecting unit 16 receives an infrared ray 
signal from handy remote controller 4 and detects an 
operation instruction from the received infrared ray sig- 
nal. The operation instruction specifies such operations 
as follows: moving the cursor (when cross key 41 is 40 
pressed); and determining an icon (when enter key 43 
is pressed). Operation detecting unit 16 outputs the de- 
tected operation instruction to browser 25. 

Cache manager 1 7, when an icon is determined on 
the current screen and the next interactive screen is dis- 45 
played, obtains a plurality of contents that may be dis- 
played after the "next interactive screen." Cache man- 
ager 17 ; while operation detecting unit 16 waits for an 
operation instruction to be input on the "next interactive 
screen," instructs TS decoder 1 1 to receive presentation so 
streams and NVTs with higher ranks to be displayed 
which have not been stored in navigation cache unit 14 
or presentation cache unit 15, and instructs cache 
processing unit 21 to store the received presentation 
streams in presentation cache unit 15 and to store the ss 
received NVTs in navigation cache unit 14. 

The presentation streams and NVTs that may be 
displayed next are determined by cache manager 1 7 as 



follows: cache manager 17 refers to the hyperlink table 
of the current NVT to determine the link-target contents, 
namely interactive screens that may be called from the 
related icons being displayed, then determines the pres- 
entation streams and NVTs belonging to the contents. 

The presentation streams and NVTs with higher 
ranks to be displayed are determined as follows: cache 
manager 17 determines these presentation streams 
and NVTs based on (1) the statistics table showing the 
frequency in determination for each presentation stream 
and NVT, (2) the "rank" column in the hyperlink table of 
NVTs, (3) the icon currently in focus. 

The presentation streeams and NVTs with higher 
ranks need be determined since some NVTs may in- 
clude as many icons as cannot be stored in navigation 
cache unit 14. It is required that as many icons as can 
be stored in navigation cache unit 14 are selected 
among those included in such NVTs. This is the same 
for presentation cache unit 15. 

Suppose the maximum number of NVTs and pres- 
entation streams that can be stored in navigation cache 
unit 14 and presentation cache unit 15 is five respec- 
tively. In this case, the link-target presentation streams 
[2]-[5] and NVTs[2]-[5] of NVT[1] can respectively be 
stored in navigation cache unit 14 and presentation 
cache unit 15. On the other hand, all of the link-target 
presentation streams[41]-[49] and NVTs[41]-[49] of 
NVT[12] cannot be stored in navigation cache unit 14 
and presentation cache unit 15. Thus, the necessity for 
selecting NVTs and presentation streams. 

In addition, presentation streams and NVTs which 
have not been stored in navigation cache unit 1 4 or pres- 
entation cache unit 15 are selected. This is because 
once a presentation stream or an NVT is stored in each 
unit, it is not deleted and kept to be stored (this will be 
described later). Accordingly, this operation is per- 
formed not to repeat the same operation of storing pres- 
entation streams or NVTs in the units. 

The maximum number of NVTs and presentation 
streams that can be stored in navigation cache unit 14 
and presentation cache unit 15 are determined based 
on the time required to store all the NVTs and presen- 
tation streams. This is because NVTs and presentation 
streams are repeatedly sent and that receiving a desired 
data takes as much wait time as the cycle period of rep- 
etition. The wait time increases as the number of NVTs 
and presentation streams to be received increases. 
Therefore, it may happen that the storing of NVTs and 
presentation streams does not end if the number is too 
great. As a result, it is desirable to calculate the wait time 
and to limit the number of NVTs and presentation 
streams to be stored not to exceed the presumed wait 
time. 

Statistics table storing unit 18 stores the statistics 
table that shows the frequency in determination for each 
presentation stream and NVT. FIG. 1 2 shows a statistics 
table stored in statistics table storing unit 18. As shown 
in FIG.1 2, the statistics table includes the statistics val- 
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ue for each NVT which is the number of determinations 
of the past. Note that the mean value on daily basis or 
time-of-the-day basis or standard deviation may be 
used instead of the number of determinations. 

Mode managing unit 19 manages the cache mode 
which indicates the best one among: (1) the statistics 
table, (2) the "rank" column in the hyperlink table, and 
(3) the icon currently in focus so that the best cache 
mode is used by cache manager 17 in generating the 
cache table. Mode managing unit 1 9 changes the cache 
mode according to the state of the terminal apparatus. 

Cache table storing unit 20 stores the cache table 
generated by cache manager 17. 

Cache manager 17 determines the presentation 
streams and NVTs to included in the cache table based 
on (1) the statistics table, (2) the "rank* 1 column in the 
hyperlink table, and (3) the icon currently in focus, and 
generates the cache table. FIGS.13A-13C show cache 
tables. 

FIG.13A shows a cache table which is generated 
based on the statistics table shown in FIG. 12. The cache 
table shows the highest ranking link-target contents 
among those specified in the hyperlink table of NVT[1 2]. 

FIG.13B shows a cache table which is generated 
based on the "rank" column in the hyperlink table shown 
in FIG.5C. The cache table shows the highest ranking 
link-target content among those specified in the hyper- 
link table of NvT[12]. 

FIG.13C shows a cache table which is generated 
based on the icon currently in focus. More specifically, 
when a plurality of icons are displayed on the current 
screen, the possible link targets for each icon currently 
displayed are evaluated by weighting the icon in focus 
with the highest value and by weighting icons adjacent 
to the icon in focus with the second highest value. 

While the cache table shown in FIG.13A includes 
contents[41 ]-[45] ( the cache table shown in FIG.1 3B in- 
cludes contents[45], [47], [46], [43], and [44], This ex- 
ample indicates that the contents of the cache table may 
greatly change depending on the cache mode. 

Cache processing unit 21 manages the start ad- 
dress and end address of each area in navigation cache 
unit 14 and presentation cache unit 15. Cache process- 
ing unit 21 increases or decreases the capacity of each 
area in navigation cache unit 14 and presentation cache 
unit 15 according to the size of the NVT or the presen- 
tation stream to be stored in the area. In doing so, cache 
processing unit 21 also performs writing, reading, or a 
garbage collection. 

In the writing, cache processing unit 21 writes an 
NVT output from TS decoder 11 and a presentation 
stream output from input switching unit 22 respectively 
in navigation cache unit 14 and presentation cache unit 
15 at areas closer to the start of each unit. 

Cache processing unit 21 , on receiving a read re- 
quest from cache manager 1 7, reads the requested NVT 
or presentation stream from navigation cache unit 14 or 
presentation cache unit 15, then outputs the read NVT 



to browser 25 and the read presentation stream to input 
switching unit 22. 

In the garbage collection, cache processing unit 21 
puts a mark indicating a hit on a presentation stream or 
5 an NVT when the presentation stream or the NVT is dis- 
played; cache processing unit 21 deletes the rest of the 
presentation streams or NVTs. When free areas exist 
between the areas for the hit presentation streams or 
NVTs, cache processing unit 21 moves the hit presen- 
ce tation streams or NVTs so that free areas are arranged 
in sequence. 

Input switching unit 22 transfers the transport pack- 
ets of the video elementary stream and the video ele- 
mentary stream received by TS decoder 11 to AV de- 
cs coder 12. Input switching unit 22 transfers the transport 
packets of the video elementary stream and the video 
elementary stream to presentation cache unit 15 when 
Input switching unit 22 receives a switch instruction from 
cache manager 1 7 tor switching the transfer target from 

20 AV decoder 12 to presentation cache unit 1 5. 

Input switching unit 22, on receiving a switch in- 
struction from cache manager 17 for using the transport 
packets in presentation cache unit 15. reads the trans- 
port packets from presentation cache unit 1 5 and trans- 

25 fers the read transport packets to AV decoder 1 2. 

Graphic storing unit 23 stores the bit map for inform- 
ing the operator of a display break. In this embodiment, 
the bit map represents a character sequence indicating 
"WAIT FOR A MOMENT." 

30 Graphic displaying unit 24 outputs the character se- 
quence indicating "WAIT FOR A MOMENT" stored in 
graphic storing unit 23 to AV decoder 12 when there is 
no NVT with a bit map that can be displayed. 

Browser 25 fetches PIDs of link-target video ele- 

35 ment and audio element by referring to the hyperlink ta- 
ble and PMT based on the above procedures: speci- 
fying Link-Target NVT>, <Specifying Link-Target Video 
Element>, and <Specifying Link-Target Audio Ele- 
ment^ and outputs the fetched PIDs to AV decoder 12 

40 via AV decoder controlling unit 13. Browser 25 also in- 
structs AV decoder 1 2 to decode the video element and 
audio element related to the fetched PIDs to generate 
one AV signal. 

Browser 25, when TS decoder 11 outputs a trans- 

45 port packet of the NVT sub-stream, fetches bit maps 
from the transport packet and outputs the bit maps to 
AV decoder 12, with an instruction for combining the bit 
maps with the image. Browser 25 executes a processing 
program included in the navigation information. With this 

so execution, the bit maps are displayed on the screen. 
Browser 25 instructs AV decoder controlling unit 1 3 to 
change the color of icons when the operator performs a 
cursor move operation. 

Now, the operation of the terminal apparatus is de- 

55 scribed below with reference to flowcharts shown in 
FIGs.14-17 on cache manager 17 and in FIGs. 18-21 on 
browser 25. This is because cache manager 17 and 
browser 25 take important parts among the above men- 
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tioned components in the operation of the terminal ap- 
paratus which is mainly achieved by software. 

In step S51 of the flowchart shown in FIG. 14, cache 
manager 17 sets variable p to the root number. Here, 
the variable p indicates an index number of a "content, s 
" NVT, video element, or audio element to be read, and 
the root number indicates an index number of a "con- 
tent," NVT, video element, or audio element which is at 
the root of the tree structure which is uniquely defined 
by PAT and PMT. In the present example shown in FIG. 10 
7, the root number is specified as "i." 

Suppose variable p is set to "1 D in step S51 . In step 
S52, demodulator 10 and TS decoder 11 receive pres- 
entation stream[p] and NVT[p] and store them in pres- 
entation cache unit 15 and navigation cache unit 14 re- is 
spectively. 

Step S53 is described in detail in the flowchart 
shown in FIG. 15. Note that the flowcharts shown in 
FIGs.15-17 show processing procedures for the con- 
tents one generation later than contenl[p]. Here, "the 20 
contents one generation later than content[p]" indicates 
that content[p] links to "the contents one generation later 
than content[p] w in the tree structure in which a content 
is linked from the NVT of the previous content. In this 
case : contents one generation later than content[1 ] are 25 
contents[2], [3], [4], and [5]. Similarly, contents two gen- 
erations later than content[1 ] are contents[1 1 ] ; [1 2], [21 ], 
[22], [23], [32]..., as shown in FIG.7. 

In step S60 of FIG. 15, initial values are set for the 
index number and the cache end flag. Here, index 30 
number is a variable specifying each content in the 
cache table. Suppose in the present embodiment, the 
initial value of the index number is set to u 1 When the 
cache end flag is "1 it indicates that the NVT and pres- 
entation stream have been stored. When the cache end 35 
flag is a 0° it indicates that the NVT and presentation 
stream have not been stored. Suppose in the present 
embodiment, the initial value of the cache end flag is set 
to "1." Note that in the following description, each of a 
plurality pieces of information included in one NVT is 40 
represented as "NVT-NAVI.'' 

Step S61 is described in detail in the flowchart 
shown in FIG. 16. 

In step S77 of FIG. 16, cache manager 17 obtains a 
cache mode which is managed by mode managing unit 45 
19. 

In step S78, it is judged whether the cache mode is 
that of statistics value. If it is judged as yes, control goes 
to step S80. In step S80, s higher ranking contents 
among those ranging from content(NVT[p].NAVI so 
[START], link destination) to content(NVT[p].NAVI 
[END].Iink destination) are registered in the cache table, 
based on the statistics value. 

If it is judged as no in step S78, control goes to step 
S79. In step S79, it is judged whether the cache mode ss 
is that of the "rank" column in the hyperlink table. If it is 
judged as yes, control goes to step S81 . In step S81 , s 
higher ranking contents among the contents from con- 



tent(NVT[p].NAVI[START].link destination) to content 
(NVT[p].NAVI[END].iink destination) are registered in 
the cache table, based on the "rank" column in the hy- 
perlink table. 

If it is judged as no in step S79, control goes to step 
S82. In step S82. the cache table is generated, in which: 
a content including the icon currently in focus is deter- 
mined as rank 1 ; a content including an icon in the right 
or left hand side of the icon in focus is determined as 
rank 2; a content including an upper or lower icon of the 
icon in focus is determined as rank 3; and a content in- 
cluding an icon in a slanting direction from the icon in 
focus is determined as rank 4. 

Note that in an initial stage after the terminal appa- 
ratus has been activated, a substantially effective rank- 
ing cannot be expected for the cache modes of statistics 
value and the icon currently in focus. Accordingly, the 
initial cache mode is set to that of the "rank" column in 
the hyperlink table by mode managing unit 19. Thus, in 
the present embodiment, it is judged as no in step S78 
and yes in step S79, and control goes to step S81. 

In step S81, s higher ranking contents among the 
contents from content(NVT[p].N AVI [START], link desti- 
nation) to content(NVT[p].NAVI[END].link destination) 
based on the "rank" column in the hyperlink table are 
registered in the cache table. More specifically, four 
higher ranking contents among the contents from con- 
ten t(NVT[1]. N AVI [START], content [2]) to content(NVT 
[p].NAVI[END].content[5]), determined based on the 
"rank" column in the hyperlink table, namely contents 
[2]-[5], are registered in the cache table tn the order of 
the ranking. From steps of the flowchart shown in FIG. 
1 6, control returns to step S62 in the flowchart of FIG. 15. 

In step S62, content[q] in the cache table at the po- 
sition of the index number is obtained. Suppose the 
cache table generated through the procedures of FIG. 
16 includes contents[2], [3], [4], and [5]. Since in this 
case, the index number is "V the first content in the 
cache table, namely, content[2] is obtained by cache 
manager 17. Then, in step S63, variable q is substituted 
for variable p. In step S64, NVT[p], video element[p], 
audio element[p], and the PCR of content[p] are ob- 
tained. 

In step S65, it is judged whether navigation cache 
unit 14 includes a free area with enough capacity for 
storing NVT[p]. If not, control goes to step S67. In step 
S67, N VT[p] is stored in a marked area storing the oldest 
NVT. In the present case, since variable p is "2" and nav- 
igation cache unit 14 includes a free area with enough 
capacity for storing NVT[2], it is judged as yes in step 
S65, allowing the control to go to step S66. In step S66, 
NVT[2] is stored in navigation cache unit 14. 

In step SB 3 in the flowchart of FIG. 17, the PIDs of 
video elementfp] and audio element[p] of presentation 
stream[p] are obtained. Then, in step S84, the obtained 
PIDs are set in the TS decoder, input switching unit 22 
changes the destination of the output from input switch- 
ing unit 22 to presentation cache unit 15, then Video el- 
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ement[p] and audio element[p] are output to input 
switching unit 22. In this way. transport packets of the 
video elementary stream and video elementary stream 
start to be received. Cache manager 17 judges whether 
presentation cache unit 15 includes a free area with 
enough capacity for storing presentation streamfp] in 
step S85. 

In the present case, since variable p is "2," and pres- 
entation cache unit 15 includes a free area with enough 
capacity for storing NVT[2], it is judged as yes in step 
S85, allowing the control to go to step S86. In step S86, 
cache manager 17 stores presentation stream[2] in 
presentation cache unit 1 5. 

If it is judged as no in step S85, control goes to step 
S95. In step S95, it is judged whether presentation 
cache unit 1 5 includes a free area with enough capacity 
for storing the first frame of presentation stream[p]. If 
judged as yes, control goes to step S96. In step S96, 
the first frame is stored in presentation cache unit 15. 

If judged as not in step S95, control goes to step 
S97. In step S97, the first frame of presentation stream 
[p] is stored in a marked area of presentation cache unit 
1 5 storing the oldest presentation stream, then control 
goes to step S92. 

As will be understood from the above description, 
as many whole presentation streams as possible are 
stored in presentation cache unit 15 if presentation 
cache unit 1 5 has enough capacity; only the first frames 
of presentation streams are stored in presentation 
cache unit 15 if presentation cache unit 15 does not 
have enough space for storing a whole presentation 
stream. 

Accordingly, high ranking presentation streams are 
stored in presentation cache unit 15 while presentation 
cache unit 15 has enough capacity. That means the 
whole video elements of the high ranking presentation 
streams are stored in presentation cache unit 1 5. In con- 
trast, for low ranking presentation streams, only the first 
frames the video elements of the low ranking presenta- 
tion streams are stored in presentation cache unit 15. 
This is because there is a low possibility for the low rank- 
ing presentation streams to be displayed. 

In step s92, the index number is incremented by 
one. In step S90, it is judged whether a content is reg- 
istered in the cache table at the position of the index 
number. If judged as yes, control goes to step S93 in 
which the cache end flag is set to "1," then control re- 
turns to step S54. If judged as yes in step S90, control 
goes to step S62 to enter the second cycle of the pro- 
cedure. 

In step S62 of the second cycle, content[q] in the 
cache table at the position ol the index number is ob- 
tained. In the present case, the index number is current- 
ly U 2 B since the value has been incremented by one in 
step S92. Accordingly, the second content in the cache 
table, namely, content[3] is obtained here. Then, in step 
S63, variable q (currently, 3) is substituted for variable 
p. In step S64, NVT[3], video element[3], audio element 



[3], and the PCR of content[3] are obtained. 

Suppose in step S66, NVT[3] is stored in navigation 
cache unit 14 as the third NVT. Also suppose presenta- 
tion stream[3] including video element[3] and audio el- 

5 ement[3] is stored in presentation cache unit 15 as the 
third presentation stream. The index number is incre- 
mented by one again in step S92, then controlgoes to 
step S62 of the third cycle. 

In step S62 of the third cycle, content[q] in the cache 

10 table at the position of the index number is obtained. 
Since the index number is currently n 3 t u the third content 
in the cache table, namely, content[4] is obtained here. 
Then, in step S63, variable q (currently, 4) is substituted 
for variable p. Thea in step S64, NVT[4], video element 

is [4], audio element[4], and the PCR of content[4] are ob- 
tained. 

Suppose in step S66, NVT[4] is stored in navigation 
cache unit 14 as the fourth NVT. Also suppose presen- 
tation stream(4] including video element[4] and audio el- 

^o ement[4] is stored in presentation cache unit 15 as the 
fourth presentation stream. The index number is incre- 
mented by one again in step S92, then control goes to 
step S62 of the fourth cycle. 

In step S62 of the fourth cycle, content[q] in the 

25 cache table at the position of the index number is ob- 
tained. Since the index number is currently "4, fl the 
fourth content in the cache table, namely, content[5] is 
obtained here. Then, in step S63, variable q (currently, 
5) is substituted for variable p. Then, in step S64, NVT 

30 [5], video element[5], audio element[5], and the PCR of 
content[5] are obtained. 

Suppose in step S66, NVT[5] is stored in navigation 
cache unit 14 as the fifth NVT. Also suppose presenta- 
tion stream[5] including video element[5] and audio el- 

35 ement[5] is stored in presentation cache unit 15 as the 
fifth presentation stream. The index number is incre- 
mented by one again in step S92. This time, it is judged 
as no in step S90. As a result, control goes to step S93 
in which the cache end flag is set to M," and control re- 

40 turns to step S54 shown in FIG. 14. 

In step S54, it is judged whether an input of an op- 
eration instruction is waited for on the interactive screen. 

If judged as yes in step S54, control goes to step 
S55. In step S55, content [i] corresponding to the current 

45 interactive screen is identified. The variable i indicates 
the index number of the content currently displayed in 
the interactive screen. Then, in step S56, the icon being 
in fucus, namely, "NVTfl.NAVItm]" is identified, where 
variable m indicates an index number of a piece of nav- 

so igation information including a bit map of the icon being 
in focus in NVT[i]. Suppose the interactive screen shown 
in FIG.22A is currently displayed and the icon indicating 
"NEW MOVIE INFORMATION" is in focus. Under this 
condition, content[1] is identified in step S55, and "NVT 

55 [l].NAVI[1] tt is identified in step S56. 

In step S57, a link-target content[k] specified by the 
hyperlink information of navigation information n NVT[i]. 
NAVI[m] n is obtained. Then, in step S59, variable k is 
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substituted for variable p. Control returns to step S53 so 
that "the contents one generation later than contentfp]" 
are read. 

In the present case, link-target content[2] specified 
by the hyperlink information of navigation information 5 
"NVTf-n.NAVinr is obtained. Then, in step S59, varia- 
ble k (currently 2) is substituted for variable p. Control 
returns to step S53 so that "the contents one generation 
later than content[2]° are read. In step S53, contents 
[11], [12], and [21] are read. 70 

Now, the operation of the terminal apparatus is de- 
scribed with reference to the flowcharts shown in FIGs. 
18-21 related to browser 25. 

After the terminal apparatus is activated, browser 
25 sets variable i to the root number in step S2 shown is 
in FIG. 1 8. In step S3, NVT[i], video element[i], and audio 
element[i] are obtained. In step S4, the interactive 
screen generated from the obtained NVTfi], video ele- 
mentfi], and audio elementfi] is displayed. 

Step S4 is described in detail in the flowchart shown 20 
in FIG. 19. 

In the flowchart shown in FIG. 19, browser 25 oper- 
ates for switching the interactive screen at high speed. 

In step S21, it is judged whether presentation 
stream[i] is stored in presentation cache unit 15. If 2s 
judged as yes, control goes to step S22. In step S22, 
cache processing unit 21 is instructed to read presen- 
tation stream[i] from presentation cache unit 15. In step 
S23, input switching unit 22 is instructed so that streams 
are distributed to AV decoder 12 from presentation 30 
cache unit 15. 

If judged as no in step S21 , control goes to step S25. 
In step S25, it is judged whether the first frame of pres- 
entation streamfi] is stored in presentation cache unit 
15. If judged as yes, control goes to step S26. In step 3S 
S26, cache processing unit 21 is instructed to read the 
first frame of presentation streamfi] from presentation 
cache unit 15. In step S27, input switching unit 22 is in- 
structed so that streams are distributed to AV decoder 
12 from presentation cache unit 15. In step S28, AVde- 40 
coder controlling unit 13 is instructed to issue the PIDs 
of video elementfi] and audio element[i] to AV decoder 
12, and the first frame of presentation streamfi] in pres- 
entation cache unit 15 is displayed. 

If it is judged as no in step S25, control goes to step 45 
S29. In step S29, graphic displaying unit 24 outputs the 
character sequence indicating "WAIT FOR A MOMENT" 
stored in graphic storing unit 23 to AV decoder 12 so 
that the character sequence is displayed on the screen, 
the screen being displayed as a default screen. so 

In step S30, input switching unit 22 is instructed so 
that streams are distributed to AV decoder 12 from TS 
decoder 11. 

In step S24, AV decoder controlling unit 13 is in- 
structed so that the PIDs of video elementfi] and audio ss 
elementfi] are issued to AV decoder 12. With such an 
arrangement, AV decoder 1 2 decodes either of the pres- 
entation stream read from presentation cache unit 15 



and the presentation stream received by TS decoder 11 
using the PIDs sent from AV decoder controlling unit 13. 

In step S31 shown in FIG.20. it is judged whether 
NVTfi] is stored in navigation cache unit 14. If judged as 
yes, control goes to step S32. In step S32, NVTfi] is 
fetched from navigation cache unit 14. 

If judged as not in step S31 , control goes to step 
S42. In step S42, an icon display instruction is issued to 
graphic displaying unit 24. Graphic displaying unit 24, 
on receiving this instruction, displays the character se- 
quence "WAIT FOR A MOMENT- stored in graphic stor- 
ing unit 23, as the default screen. 

In step S43, the table identifier of NVTfi] is output 
to the TS decoder. In step S44, the TS decoder is in- 
structed to receive NVTfi]. In step S45, it is judged 
whether NVT[i] has been received. If judged as yes, con- 
trol goes to step S46. 

In step S46, all the bit maps included in "NVTfi]. 
NAVI [start]"-"NVT[i].NAVL[end] B are transformed for 
display. I n step S47, the transformed bit maps are output 
to the AV decoder. In step S48, the AV decoder com- 
bines the transformed bit maps with the image which is 
the decoded presentation stream[i]. In step S49 shown 
in FIG. 21, it is judged whether NVTfi] has been stored 
in navigation cache unit 14. If judged as yes, control 
goes to step S101. In step S101, the NVTfi] stored in 
navigation cache unit 14 is marked. If judged as no in 
step S49, control goes to step S100 in which NVTfi] is 
stored in navigation cache unit 14 with a mark. 

In step S102, it is judged whether presentation 
streamfi] has been stored in presentation cache unit 1 5. 
If judged as yes, control goes to step S 1 04. 1 n step S 1 04, 
the presentation streamfi] stored in presentation cache 
unit 15 is marked. If judged as no in step S102, control 
goes to step S103 in which presentation streamfi] is 
stored in presentation cache unit 15 with a mark. 

In step SI 06, the cache end flag is set to 0. In step 
S107, variable m is set to 1. In step S10B, the bit map 
of NVTfi]. NAVfm] is made to be in focus. Note that in the 
present embodiment, a bit map specified by the first 
piece of navigation information is made to be in focus. 
However, a bit map specified by any piece of navigation 
information may be made to be in focus. Control returns 
to step S5 shown in FIG. 18. 

In step S5, it is judged whether an operation instruc- 
tion has been input on the interactive screen. If judged 
as yes in step S5 by operation detecting unit 16, control 
goes to step S6. In step S6, it is judged whether the op- 
eration specified by the operation instruction is a deter- 
mination operation. If judged as no, control goes to step 
S7. In step S7, it is judged whether the operation spec- 
ified by the operation instruction is a cursor move oper- 
ation. 

If judged as yes, control goes to step S8. In step S8, 
the state of being in focus is cleared for the bit map of 
NVTfi]. NAVI [m]. In step S9, variable m is updated to in- 
dicate a link-target index number. In step S10, the bit 
map of NVTfi]. N AVI [m] is made to be in focus. Control 
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returns to step S5. 

If it is judged that the input operation is the determi- 
nation operation in step S6, control goes to step S11 . In 
step S11, the bit map of NVT[i].NAVI[m] is made to be 
in the determination state. In step S1 2, a link-target con- 
tent^] specified by NVT[i].NAVI[ml in the hyperlink table 
is obtained. In step S13, NVTfk], video eiement[k], and 
audio element[k] are obtained. Instep S14, the statistics 
value for NVT[k] in the statistics table is incremented by 
one. In step S15, V is substituted for "i." In step S16, 
the presentation streams and NVTs without marks are 
respectively deleted from presentation cache unit 15 
and navigation cache unit 14. In step S18, it is judged 
whether the cache end flag is "1 Control stays at step 
S18 until the cache end flag is "I." This indicates that 
the next operation is not started until cache manager 1 7 
completely stores the presentation streams and NVTs 
one generation later into presentation cache unit 15 and 
navigation cache unit 14 respectively. In case the repro- 
duction of the presentation stream ends while the next 
operation is not started in the above process, browser 
25 repeats reproduction of the presentation stream, 
keeps on displaying a still image of the last frame or the 
like. If it is judged as yes in step S18, control returns to 
S4. 

Now, the operation on the contents shown in FIG. 7 
is described, based on the above flowcharts. 

FIG.22A shows the interactive screen generated 
from NVT[1], video element[1], and audio element[1] in 
step S4 and is displayed on TV receiving unit 3. The 
interactive screen is composed of a shot image gener- 
ated from presentation stream[1] and several icons su- 
perimposed on the shot image. The voice of an an- 
nouncer is output. While the interactive screen is dis- 
played, cache manager 17 obtains contents[2], [3], [4], 
and [5] specified in the handler definition table 302 and 
hyperlink table 304 of NVT[1]. Then, presentation 
streams [2], [3], [4], and [5] are stored in presentation 
cache unit 15 via demodulator 10 and TS decoder 11. 
Similarly, NVTs[2], [3], [4], and [5] are stored in naviga- 
tion cache unit 14 via demodulator 10 and TS decoder 
11. 

Currently displayed presentation stream[1] and 
NVT[1] are marked respectively in presentation cache 
unit 15 and navigation cache unit 14, in steps 101 and 
104: FIG.10A and FIG. 11 A respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

When the operator determines an icon indicating 
"NEW MOVIE INFORMATION" on the current screen, 
the processing goes through steps S11 to S18 and re- 
turns to step S4 in which browser 25 displays the inter- 
active screen generated from NVT[2], video element[2] t 
and audio element[2]. FIG.22B shows the interactive 
screen at this stage. 

Currently displayed presentation stream[2] and 
NVT[2] are marked respectively in presentation cache 
unit 15 and navigation cache unit 14, in steps 101 and 



104. FIG.10B and FIG.11B respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 after the above operation. 

After presentation stream[2] and NVT[2] are dis- 

5 played as described above, areas without marks are de- 
leted from navigation cache unit 14 and presentation 
cache unit 1 5. FIGs. 1 0C and 1 1 C respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 

to White the interactive screen is displayed, cache 
manager 17 obtains contents[11], [12], and [21] speci- 
fied in the hyperlink information of NVT[2]. Then, pres- 
entation streams[11], [12], and [21] are stored in pres- 
entation cache unit 15 via demodulator 10 and TS de- 

is coder 11. Similarly, NVTS[11], [12], and [21] are stored 
in navigation cache unit 14 via demodulator 10 and TS 
decoder 11. FIGS.10D and 11 D respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 

20 Suppose the operator determines an icon indicating 
"THE TERROR OF THE HUGE TORNADO (DISTRIB- 
UTED BY AAA COMPANY)." Then, the processing goes 
through steps S1 1 to S1 8 and returns to step S4 in which 
browser 25 displays the interactive screen generated 

2S from NVT[12], video eiement[12], and audio element 
[12]. F1G.22C shows the interactive screen displayed at 
this stage. 

Currently displayed presentation stream[12] and 
NVT[1 2] are marked respectively in presentation cache 
30 unit 15 and navigation cache unit 14, in steps 101 and 
104. FIG.10E and FIG.11E respectively show the con- 
tents of navigation cache unit 14 and presentation cache 
unit 1 5 after the above operation. 

After presentation stream[12] and NVT[12] are dis- 
ss played as described above, areas without marks are de- 
leted from navigation cache unit 14 and presentation 
cache unit 15. FIGs.10F and 11 F respectively show the 
contents of navigation cache unit 14 and presentation 
cache unit 15 after the above operation. 
40 While the interactive screen is displayed, cache 
manager 17 obtains contents[41]-[49] specified in the 
hyperlink information of NVT[12]. Then : presentation 
streams[41]-[49] and NVTs[41]-[49] are attempted to be 
stored respectively in presentation cache unit 15 and 
45 navigation cache unit 14. However, as shown in FIGs. 
10F and 11F, there are only two free areas in each of 
the tables. As a result, presentation streams[41] and 
[42] and NVTs[41] and [42] are stored in two areas, re- 
placing with two oldest presentation streams and NVTs 
so respectively in presentation cache unit 15 and naviga- 
tion cache unit 14. Presentation streams[43] and [44] 
and NVTs[43] and [44] are stored in two free areas of 
presentation cache unit 1 5 and navigation cache unit 1 4, 
respectively. FIGs.10G and 11G respectively show the 
55 contents of navigation cache unit 14 and presentation 
cache unit 1 5 after the above operation. 

Now, the operation corresponding to the determina- 
tion of "RETURN" icon is described. Suppose the oper- 



15 



29 



EP 0 827 340 A2 



30 



ator determines an icon indicating "RETURN" in the in- 
teractive screen as shown in FIG.22B. By referring NVT 
[2], it is determined that the icon is related to the index 
number 4, and that the link-destination is content[1]. 

FIG.10B and FIG.11B respectively show the con- 
tents of navigation cache unit 1 4 and presentation cache 
unit 15 at this stage. As will be understood from the ta- 
bles shown in FIG.IOBand FIG.11B, NVT[1] and pres- 
entation stream[1], namely, the above link targets, have 
already been stored. Accordingly, NVT[1] and presen- 
tation stream[1] can immediately be obtained from these 
tables and displayed as the interactive screen as shown 
in FIG.22A. 

When the operator determines an icon indicating 
"NEW MOVIE INFORMATION" here, the interactive 
screen shown in FIG.22B is immediately displayed 
since presentation stream[2] and NVT[2] are stored in 
presentation cache unit 1 5 and navigation cache unit 1 4 
with marks, respectively. As will be understood from the 
above description, the construction in which presenta- 
tion streams and NVTs are stored in presentation cache 
unit 15 and navigation cache unit 14 with marks 
achieves the high-speed return to the previous screen 
responding to the determination of the "RETURN" icon. 

As has been described above, the TV broadcasting 
system of the present embodiment enables an immedi- 
ate display of an interactive screen since the link-target 
NVT and presentation stream can immediately be ob- 
tained from navigation cache unit 14 and presentation 
cache unit 15 and displayed, responding to the determi- 
nation of one icon in the previous screen. 

The TV broadcasting system of the present embod- 
iment also enables storage of a plurality of presentation 
streams and NVTs which have possibility of being dis- 
played next in presentation cache unit 1 5 and navigation 
cache unit 14 in advance while the current interactive 
screen is displayed. 

The above operation also has an effect that the op- 
erator does not recognize the storing of presentation 
streams and NVTs since the storage is done while the 
TV broadcasting system waits for an input of an opera- 
tion instruction on the currently displayed interactive 
screen. <Second Embodiment 

The present embodiment achieves a TV broadcast- 
ing system which uses video elements including still pic- 
tures, while the TV broadcasting system of the first em- 
bodiment uses video elements which include only mo- 
lion pictures. 

FIG. 23 shows the contents of the transport streams 
broadcast in the present embodiment. Each of VE[0], 
VE[1], VE[2] t ... includes still pictures. While in the first 
embodiment, each video element has a different PID, in 
the second embodiment, each video element has a 
common PID which is "0x0084," as shown in FIG.23. 
This is because it is intended in the second embodiment 
that a large number of still pictures are broadcast and 
that the length of the PID is not enough for assigning a 
unique identifier to each video element. Though each 



video element has a common PID, it has another iden- 
tifier called "streamjd." In FIG.23, for example, VE[0] 
has streamjd "OxeO," and VE[1] has streamjd "0xe1 , D 
as well as a common PID, "0x0084." 

5 While in the first embodiment, the transport stream 
is composed of a sequence of video elements, in the 
second embodiment, the transport stream includes a 
private section called video element table (VET) be- 
tween video elements. As shown in FIG.23, for example, 

io VET[15] is inserted in immediately before VE[0], VET 
[16] in immediately before VE[1]. Similarly, the transport 
stream of the present embodiment includes a private 
section called audio element table (AET) between the 
audio elements. 

is FIG.24A shows the content of VET[1 5]. VET[1 5] in- 
cludes an identifier called VE Jd_extension whose val- 
ue is "0x0001 which is unique to VET[1 5]. VET[1 5] also 
includes a PID, "0x0083." Though VET[15] is inserted 
in immediately before VE[0], it has the streamjd "Oxef" 

20 of VE[1 5] which is at a position about a dozen VEs away. 

FIG.24B shows the content of VET[16]. VET[16] in- 
cludes VEJd_extension whose value is "0x0000," 
which is unique to VET[16]. VET[16] also includes the 
same PID ; "0x0083," as that of VET[15]. Though VET 

25 [16] is inserted in immediately before VE[1], it has the 
streamjd "OxeO" of VE[16] which is at a position about 
a dozen VEs away. In this way, each VET has the 
streamjd of a corresponding VE which is at a position 
a certain number of VEs away 

30 FIG. 25 shows a content of a hyperlink table in an 
NVT of the second embodiment. The hyperlink table of 
the second embodiment differs from that of the first em- 
bodiment in that it includes "VE_id_extension" 2547 in- 
stead of "VE_compJag" and "AEJd_extension" in- 

35 stead of "AE_comp Jag. " The " VE Jd extension" column 
and °AEJd_extension" column respectively show a 
VE Jd_extension of a VET and an AE_id_extension of 
an AET. For example, "0x0000" and "0x0001" included 
in "VEJd extension" 2547 shown in FIG.25 are 

40 VEJd_extensions of VET[16] and [15], respectively. 
This indicates that the hyperlink table defines link-target 
VETs. 

From the above description, the following proce- 
dures are required in the second embodiment for chang- 
es jng still pictures. 

A VEJd_extension written in hyperlink table -» a 
VET with the VE Jd_extension -» a streamjd included 
in the VET — > a VE with the streamjd 

cache manager 17 operates as follows in the sec- 
50 ond embodiment. 

When the operator determines an icon on an inter- 
active screen, cache manager 17 detects an HDJndex 
number corresponding to the determined icon by refer- 
ring to the object definition table, detects an HLJndex 
55 number corresponding to the HDJndex number by re- 
ferring to the handler definition table, and detects a 
VEJd_extension corresponding to the HLJndex 
number by referring to the hyperlink table. Cache man- 
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agar 17 allows demodulator 10 and TS decoder 11 to 
receive a VET having the detected VE_id extension 
among the plurality of VETs included in the transport 
stream. Cache manager 17 fetches a streamjd and a 
component Jag from the received VET. Cache manager 
17 fetches a PID corresponding to the component_tag 
from the PMT. Cache manager 17 waits for a VE with 
the streamjd and the PID to be transmitted. !f the VE 
is transmitted, cache manager 17 receives it. 

After receiving a link-target VE in the above proce- 
dure, cache manager 17 also receives a link-target AE 
in a similar procedure. Cache manager 17 instructs in- 
put switching unit 22 to store the received VE and AE 
into presentation cache unit 15 as a presentation 
stream. 

With the above construction, it is possible for the 
digital satellite broadcasting system, which broadcasts 
a large number of still pictures, to display interactive 
screens including a still picture specified as a link des- 
tination by a determination operation in another interac- 
tive screen. This is achieved by the reference of VETs 
included between VEs in the transport stream. 

The two embodiments described above are exam- 
ples of the present invention with which best effects are 
expected. It is also possible to change the embodiments 
as follows: 

(a) In the present embodiments, the highest rank in 
the navigation information is indicated by integer 
"1 However, the highest rank may be integer "255" 
which is the highest value for 8-bit data in binary 
notation. 

(B) In the present embodiments, mode managing 
unit 1 9 manages the cache mode in cache manager 
17. However, the operator may input an instruction 
for changing a cache mode to another cache mode. 
Alternately, an NIT including the cache mode may 
be transmitted. 

(C) In the present embodiments, cache processing 
unit 21 processes both navigation cache unit navi- 
gation cache unit 14 and presentation cache unit 
15. However, navigation cache unit navigation 
cache unit 14 and presentation cache unit 15 may 
be processed by other two units, respectively. 

(D) In the present embodiments, cache manager 1 7 
suspends the reproduction until the cache end flag 
is set to "1 . ' However, the reproduction may be con- 
tinued without suspension. 

(E) In the present embodiments, cache manager 1 7 
stores each NVT and presentation stream sepa- 
rately in navigation cache unit 14 and presentation 
cache unit 15 respectively. However, demodulator 
10 and TS decoder 11 may receive a plurality of 
NVTs and presentation streams in a transport 
stream at each reception so that they are stored in 
navigation cache unit 14 and presentation cache 
unit 15 with batch processing. 

(F) In the present embodiments, cache processing 



unit 21 deletes presentation streams or NVTs for ef- 
fective use of the memory. However, the presenta- 
tion streams or NVTs may not be deleted and be 
used again if the memory capacity allows it. 

5 (G) In the present embodiments, presentation 
streams and NVTs one generation later than the 
content related to the determined icon are read in 
advance. However, a certain number of presenta- 
tion streams and NVTs may be selected from those 

io one generation later and two generations later than 
the current content and be read in advance. 

(H) In the present embodiments, presentation 
streams or NVTs without marks are deleted. How- 
ever, presentation streams or NVTs to be deleted 

1^ may be determined based on the number of times 
they have been displayed in past, with a certain 
threshold value. 

(I) Presentation cache unit 15 may be deleted from 
the construction. In such a case, the system oper- 

20 ates as follows: 

cache manager 17 obtains only NVTs having 
possibility of being displayed according to a current 
NVT in navigation cache unit 14 and stores them in 
navigation cache unit 14 while an input of an oper- 

25 ation instruction is waited for on an interactive 
screen. 

When the operator determines an icon on the 
interactive screen, the link-target content is deter- 
mined referring to the current NVT. 

30 If the link-target NVT has been stored in navi- 

gation cache unit 14, the link-target presentation 
stream is obtained according to the link-target NVT 
and is stored in navigation cache unit 14. The NVT 
and presentation stream are displayed. Such a con- 

35 struction takes more time in displaying the link-tar- 
get NVT and presentation stream since they are ob- 
tained one by one. However, it has a merit of delet- 
ing presentation cache unit 15 from the construc- 
tion. Further, in case the link-target interactive 

40 screen is composed of only the bit maps specified 
by an NVT, the presentation stream need not be ob- 
tained. This provides an effect of simplifying the 
construction and speeding up the display of the in- 
teractive screen. 

45 (j) Navigation cache unit 14 may be deleted from 
the construction, and presentation cache unit 15 
may store only presentation streams. 
(K) In the second embodiment, VEs including still 
pictures are identified by using "streamjd. " How- 

50 ever, different PIDs may be used instead of 
"streamjd. " On the other hand, though in the first 
embodiment, VEs including motion pictures are 
identified by using different PIDs, a common PID 
and "streamjd" may be used instead. 

55 (L) The procedure of the caching manager or the 
browser may be written in a machine-language pro- 
gram and be recorded in a record medium such as 
an I C card, optical disc, or floppy disk. The recorded 
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machine-language program is installed on a gener- 
al-purpose hardware apparatus for use, where the 
general-purpose hardware apparatus indicates a 
personal computer which is connected to a parabol- 
ic antenna and includes built-in decoder, TS decod- 
er, and AV decoder. Such a personal computer ex- 
ecutes the installed machine-language program to 
achieve the features of the present apparatus de- 
scribed in the first and second embodiments. 
(M) In the first embodiment, as many whole pres- 
entation streams as possible are stored in presen- 
tation cache unit 1 5. However, only the first frames 
or representative frames may be stored instead. 

Although the present invention has been fully de- 
scribed by way of examples with reference to the ac- 
companying drawings, it is to be noted that various 
changes and modifications will be apparent to those 
skilled in the art. Therefore, unless such changes and 
modifications depart from the scope of the present in- 
vention, they should be construed as being included 
therein. 



Claims 

1 . A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "V the terminal 
apparatus including: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means for, before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 



n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
5 teger satisfying 1 ss<m, and t is an integer sat- 

isfying 1^t<n; 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
10 itoring means monitors that the operator has 

performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
15 out the s pieces of image information stored in 

the cache means; and 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
20 ing means lo reproduce the piece of link-target 

image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
25 igation information in the cache means corre- 

sponding to the piece ol link-target image infor- 
mation identified by the identifying means. 

2. The terminal apparatus of Claim 1 further compris- 
30 ing: 

superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
35 image information stored in the cache means, 

a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation, wherein 
40 the monitoring means includes: 

a determination operation detecting unit for de- 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 
45 plurality pieces of link-target image information 

detected by the determination operation detect- 
ing unit. 

3. The terminal apparatus of Claim 2 further compris- 
so ing: 

default image reproducing means for, when the 
identifying means fails to identify the one out of 
the plurality pieces of link-target image informa- 
55 tion specified by the specifying means, repro- 

ducing a default image; and 
second controlling means for instructing the re- 
ceiving means to receive the piece of link-target 
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image information specified by the specifying 
means when the piece of link-target image in- 
formation is not identified by the identifying 
means, and to receive a piece of navigation in- 
formation corresponding to the piece of link-tar- 5 
get image information specified by the specify- 
ing means, and storing the received piece of 
link-target image information and the corre- 
sponding piece of navigation information in the 
cache means, wherein 10 
the superimposing means superimposes a plu- 
rality of icons on the image based on the piece 
of navigation information received by the re- 
ceiving means. 

4. The terminal apparatus of Claim 2, wherein 

the reproducing means includes: 
focus setting means for making one out of the 
plurality of icons be in focus, wherein 20 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation; and 
a focus changing unit for making another one 
out of the plurality of icons be in focus based 2s 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 30 
cus. 

5. The terminal apparatus of Claim 1 further compris- 
ing: 

35 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed; 
and 

cache table registering means for registering 40 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 4$ 
information, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
receives t pieces of navigation information cor- 50 
responding to the s pieces of image informa- 
tion. 

6. The terminal apparatus of Claim 5 further compris- 
ing: 55 

weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 



to be in focus by the focus setting means ; and 
for weighting, with a second highest value, 
icons adjacent to the one in focus, wherein 
the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

7. The terminal apparatus of Claim 6 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

8. The terminal apparatus of Claim 7, wherein 

the receiving means includes: 
a receiving unit for receiving, out of the s pieces 
of image information and t pieces of navigation 
information with corresponding identifies regis- 
tered in the cache table, a piece of image infor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece of image information with the highest 
rank; and 

writing means for writing the piece of image in- 
formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the free area. 

9. The terminal apparatus of Claim 8, wherein 

the data size judging means includes: 

a frame size judging unit for, when the data size 

judging means judges that the capacity of the 
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free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data size of a frame ol the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a frame writing unit for writing the frame of the 
piece of image information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the free area when the 
frame size judging unit judges that the capacity 
of the free area in the cache means exceeds 
the data size of the frame of the piece of image 
information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 

10. The terminal apparatus of Claim 9, wherein 

the data size judging means further includes: 
an oldest image information detecting unit for, 
out of the image information and the navigation 
information stored in the cache means, detect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 
of the free area in the cache means does not 
exceed the data size of the frame of the piece 
of image information with the highest rank and 
the piece of navigation information correspond- 
ing to the piece of image information with the 
highest rank, wherein 

the frame writing unit overwrites the frame of 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image information and the piece of oldest 
navigation information are stored. 

11. The terminal apparatus of Claim 7 further compris- 
ing: 

hit pair determining means for determining, as 
a hit pair, a pair of a piece of image information 
and a piece of navigation information which are 
specified by the operator by determining a cor- 
responding icon out of the image information 
and the navigation information stored in the 
cache means; 

mark assigning means for assigning a mark in- 
dicating a hit to the pair of the piece of image 



information and the piece of navigation infor- 
mation determined as the hit pair by the hit pair 
determining means; and 
area freeing means for freeing areas to which 
5 the mark is not assigned by the mark assigning 

means, out of the image information and the 
navigation information stored in the cache 
means. 

10 12. The terminal apparatus of Claim 5 further compris- 
ing: 

statistics value storing means for storing a sta- 
tistics value for each piece of image information 
*s which indicates a number of times the piece of 

image information has been determined, 
wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the statistics 
20 value for each piece of image information. 

13. The terminal apparatus of Claim 12, wherein 

the monitoring means includes: 
25 an incrementing unit for incrementing, by one, 

a statistics value for a piece of image informa- 
tion when the piece of image information is de- 
termined. 

30 14. The terminal apparatus of Claim 13 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
35 table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

15. The terminal apparatus of Claim 14, wherein 

40 

the receiving means includes: 
a receiving unit for receiving, out of the s pieces 
of image information and t pieces of navigation 
information with corresponding identifies regts- 
45 tered in the cache table, a piece of image infor- 

mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank, 
wherein 

50 the terminal apparatus includes: 

data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank and the piece of 

55 navigation information corresponding to the 

piece of image information with the highest 
rank; and 

writing means for writing the piece of image in- 
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formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the free area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 

the receiving unit receives a piece of image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes 
the piece of image information with the highest 



the piece of navigation information correspond- 
ing to the piece of image information with the 
highest rank, wherein 

the frame writing unit overwrites the frame of 
5 the piece of image information with the highest 

rank and the corresponding piece of navigation 
information in an area in which the piece of old- 
est image information and the piece of oldest 
navigation information are stored. 

10 

18. The terminal apparatus of Claim 1 4 further compris- 
ing: 

hit pair determining means for determining, as 
a hit pair, a pair of a piece of image information 
and a piece of navigation information which are 
specified by the operator by determining a cor- 
responding icon out of the image information 
and the navigation information stored in the 
cache means; 

mark assigning means for assigning a mark in- 
dicating a hit to the pair of the piece of image 
information and the piece of navigation infor- 
mation determined as the hit pair by the hit pair 
determining means; and 

area freeing means for freeing areas to which 
the mark is not assigned by the mark assigning 
means, out of the image information and the 
navigation information stored in the cache 
means. 

19. The terminal apparatus of Claim 5 further compris- 
ing: 

rank information detecting means for detecting 
a piece of rank information from the piece of 
navigation information corresponding to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of 
rank information. 

20. The terminal apparatus of Claim 1 9 further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 

21. The terminal apparatus of Claim 20, wherein 
the receiving means includes: 



rank and the corresponding piece of navigation is 
information into the free area. 

16. The terminal apparatus of Claim 15, wherein 

the data size judging means includes: 20 
a frame size judging unit for, when the data size 
judging means judges that the capacity of the 
free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 25 
piece of navigation information, judging wheth- 
er the capacity ol the free area in the cache 
means exceeds the data size of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 30 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a frame writing unit for writing the frame of the 
piece of image information with the highest rank 35 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the free area when the 
frame size judging unit judges that the capacity 
of the free area in the cache means exceeds 40 
the data size of the frame of the piece of image 
information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 45 

17. The terminal apparatus of Claim 16, wherein 

the data size judging means further includes: 
an oldest image information detecting unit for, so 
out of the image information and the navigation 
information stored in the cache means, detect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 5S 
of the free area in the cache means does not 
exceed the data size of the frame of the piece 
of image information with the highest rank and 
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a receiving unit for receiving, out of the s pieces 
of image information and t pieces of navigation 
information with corresponding identifies regis- 
tered in the cache table, a piece of image infor- 
mation with a highest rank and a piece of nav- 
igation information corresponding to the piece 
of image information with the highest rank, 
wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank and the piece of 
navigation information corresponding to the 
piece of image information with the highest 
rank; and 

writing means for writing the piece of image in- 
formation with the highest rank and the corre- 
sponding piece of navigation information into 
the free area when the data size judging means 
judges that the capacity of the Iree area ex- 
ceeds the data size of the piece of image infor- 
mation with the highest rank and the corre- 
sponding piece of navigation information, 
wherein 

the receiving unit receives a piece ol image in- 
formation with a second highest rank and a 
piece of navigation information corresponding 
to the piece of image information with the sec- 
ond highest rank after the writing means writes 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information into the free area. 

22. The terminal apparatus of Claim 21 , wherein 

the data size judging means includes: 
a frame size judging unit for, when the data size 
judging means judges that the capacity of the 
free area in the cache means does not exceed 
the data size of the piece of image information 
with the highest rank and the corresponding 
piece of navigation information, judging wheth- 
er the capacity of the free area in the cache 
means exceeds the data size of a frame of the 
piece of image information with the highest rank 
and a piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank, wherein 
the writing means includes: 
a frame writing unit for writing the frame of the 
piece of image information with the highest rank 
and the piece of navigation information corre- 
sponding to the piece of image information with 
the highest rank into the free area when the 
frame size judging unit judges that the capacity 
of the free area in the cache means exceeds 
the data size of the frame of the piece of image 



information with the highest rank and the piece 
of navigation information corresponding to the 
piece of image information with the highest 
rank. 

5 

23. The terminal apparatus of Claim 22, wherein 

the data size judging means further includes: 
an oldest image information detecting unit for, 

10 out of the image information and the navigation 

information stored in the cache means : detect- 
ing a piece of oldest image information and a 
piece of oldest navigation information when the 
frame size judging unit judges that the capacity 

*s of the free area in the cache means does not 

exceed the data size of the frame of the piece 
of image information with the highest rank and 
the piece of navigation information correspond- 
ing to the piece of image information with the 

20 highest rank, wherein 

the frame writing unit overwrites the frame of 
the piece of image information with the highest 
rank and the corresponding piece of navigation 
information in an area in which the piece of old- 

2S est image information and the piece of oldest 

navigation information are stored. 

* 24. The terminal apparatus of Claim 20 further compris- 
ing: 

30 

rank information detecting means for detecting 
a piece of rank information from the piece of 
navigation information corresponding to the 
one out of the m pieces of image information 
55 reproduced by the reproducing means, wherein 

the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the rank setting means sets ranks of the m piec- 
40 es of image information based on the piece of 

rank information. 

25. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
45 and for interactively changing the image using n 
pieces of navigation information wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
so of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
ms mat ion, wherein m and n are each an integer either 
of being equal to and larger than "1 the terminal 
apparatus comprising: 
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reproducing means for reproducing the one out 
of the m pieces of image information; 
cache means for storing one out of the n pieces 
of navigation information which corresponds to 
the one out of the m pieces of image informa- 
tion; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
first receiving means for before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving, based 
on the piece of navigation information stored in 
the cache means, t pieces of navigation infor- 
mation which are respectively related to s piec- 
es of image information having possibility of be- 
ing displayed, and storing the t pieces of navi- 
gation information in the cache means, wherein 
s is an integer satisfying 1^s<m, and t is an 
integer satisfying 1^t<n; 
specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying a piece of nav- 
igation information corresponding to the one 
out of the plurality pieces of link-target image 
information specified by the specifying means 
as one out of the t pieces of navigation informa- 
tion stored in the cache means; and 
second receiving means for receiving the piece 
of link-target image information based on the 
piece of navigation information in the cache 
means corresponding to the piece of link-target 
image information specified by the specifying 
means, and storing the piece of link-target im- 
age information in the cache means, wherein 
the reproducing means reproduces the piece of 
link-target image information received by the 
second receiving means. 

26. The terminal apparatus of Claim 25 further compris- 
ing: 

superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation, wherein 
the monitoring means includes: 
a determination operation detecting unit for de- 
tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 



plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit. 

5 27. The terminal apparatus of Claim 26 further compris- 
ing: 

default image reproducing means for, when the 
identifying means fails to identify the piece of 

10 navigation information in the cache means, re- 

producing a default image; and 
controlling means for instructing the first receiv- 
ing means to receive the piece of navigation in- 
formation when the piece of navigation informa- 

15 tion is not identified by the identifying means. 

28. The terminal apparatus of Claim 27, wherein 

the reproducing means includes: 
20 focus setting means for making one out of the 

plurality of icons be in focus, wherein 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation; and 
25 a focus changing unit for making another one 

out of the plurality of icons be in focus based 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
30 tects a determination operation performed on 

the other one out of the plurality of icons in fo- 
cus. 

29. The terminal apparatus of Claim 26 further compris- 
es ing: 

rank setting means for setting ranks of the n 
pieces of navigation information based on pos- 
sibility of being displayed; and 

40 cache table registering means for registering 

identifiers of high ranking t pieces of navigation 
information in a cache table, out of the n pieces 
of navigation information, wherein 
the receiving means receives the t pieces of 

45 navigation information specified by the identifi- 

ers registered in the cache table. 

30. The terminal apparatus of Claim 25 further compris- 
ing: 

so 

weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
55 icons adjacent to the one in focus, wherein 

the rank setting means sets ranks of the n piec- 
es of navigation information based on values 
weighted by the weighting means. 



23 

BNSDOCID; <EP 0827340A2_I_> 



45 



EP 0 827 340 A2 



46 



31 . The terminal apparatus of Claim 30 further compris- 
ing: 

deleting means tor deleting, out of the identi- 
fiers of high ranking t pieces of navigation informa- 
tion in the cache table, identifiers of pieces of nav- 
igation information which have been stored in the 
cache means. 

32. The terminal apparatus of Claim 31 , wherein 

the first receiving means includes: 

a receiving unit for receiving, out of the t pieces 

of navigation information with corresponding 

identifies registered in the cache table, a piece 

of navigation information with a highest rank, 

wherein 

the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of navigation in- 
formation with the highest rank; and 
writing means for writing the piece of navigation 
information with the highest rank into the free 
area when the data size judging means judges 
that the capacity of the free area exceeds the 
data size of the piece of navigation information 
with the highest rank, wherein 
the receiving unit receives a piece of navigation 
information with a second highest rank after the 
writing means writes the piece of navigation in- 
formation with the highest rank into the free ar- 
ea. 

33. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1," the terminal 
apparatus comprising: 



means determines that the operator has per- 
formed the certain operation, receiving, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
s age information, s pieces of image information 

which have possibility of being displayed, and 
storing the s pieces of image information in the 
cache means, wherein s is an integer satisfying 
1Ss<m; 

10 specifying means for specifying one out of the 

plurality pieces o1 link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 

is identifying means for identifying the one out of 

the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out of the s pieces of image information stored 
in the cache means; and 

20 second receiving means for receiving the one 

out of the s pieces of image information from 
the cache means, wherein 
the reproducing means reproduces the one out 
of the s pieces of image information received 

2S by the second receiving means. 

34. The terminal apparatus of Claim 33 further compris- 
ing: 

30 superimposing means for superimposing, 

based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
ss played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation, wherein 
the monitoring means includes: 
a determination operation detecting unit for de- 
40 tecting a determination operation performed on 
one out of the plurality of icons, wherein 
the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 
45 ing unit. 

35. The terminal apparatus of Claim 34 further compris- 
ing: 



cache means for storing one out of the m pieces 
of image information; 

reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
first receiving means for before the monitoring 



so 



ss 



default image reproducing means for, when the 
identifying means fails to identify the piece of 
image information in the cache means, repro- 
ducing a default image; and 
controlling means for instructing the first receiv- 
ing means to receive the piece of image infor- 
mation when the piece of image information is 
not identified by the identifying means. 
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36. The terminal apparatus of Claim 35, wherein 

the reproducing means includes: 
focus setting means for making one out of the 
plurality of icons be in focus, wherein 
the monitoring means includes: 
a cursor move operation detecting unit for de- 
tecting a cursor move operation; and 
a focus changing unit for making another one 
out of the plurality of icons be in focus based 
on the cursor move operation detected by the 
cursor move operation detecting unit, wherein 
the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus. 

37. The terminal apparatus of Claim 34 further compris- 
ing: 

rank setting means for setting ranks of the m 
pieces of image information based on possibil- 
ity of being displayed; and 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information, wherein 
the receiving means receives the s pieces of 
image information specified by the identifiers 
registered in the cache table. 

38. The terminal apparatus of Claim 33 further compris- 
ing: 

weighting means for weighting, with a highest 
va!ue ; the one out of the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
icons adjacent to the one in focus, wherein 
the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

39. The terminal apparatus of Claim 3B further compris- 
ing: 

deleting means for deleting, out of the identi- 
fiers of high ranking s pieces of image information 
in the cache table, identifiers of pieces of image in- 
formation which have been stored in the cache 
means. 

40. The terminal apparatus of Claim 39, wherein 

the first receiving means includes: 
a receiving unit for receiving, out of the s pieces 
of image information with corresponding iden- 
tifies registered in the cache table, a piece of 
image information with a highest rank, wherein 



the terminal apparatus includes: 
data size judging means for judging whether 
capacity of a free area in the cache means ex- 
ceeds a data size of the piece of image infor- 
mation with the highest rank; and 
writing means for writing the piece of image in- 
formation with the highest rank into the free ar- 
ea when the data size judging means judges 
that the capacity of the free area exceeds the 
data size of the piece of image information with 
the highest rank, wherein 
the receiving unit receives a piece of image in- 
formation with a second highest rank after the 
writing means writes the piece of image infor- 
mation with the highest rank into the free area. 

41 . A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than tt 1, u the terminal 
apparatus including: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 
the cache means; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means for, before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 ^s<m, and t is an integer sat- 
isfying 1^t<n; 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
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performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in s 
the cache means; 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target to 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- *5 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibilily of being displayed; 20 
and 

cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 25 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 30 
tered by the cache table registering means and 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. 

35 

A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 45 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1," the terminal 
apparatus including: 50 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out ss 
of the m pieces of image information stored in 
the cache means; 

monitoring means for monitoring whether an 



operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means for, before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 gs<m, and t is an integer sat- 
isfying 1^t<n; 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means; 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation; 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed; 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information; and 

weighting means for weighting, with a highest 
value, the one out of the plurality of icons made 
to be in focus by the focus setting means, and 
for weighting, with a second highest value, 
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icons adjacent to the one in focus, wherein 
the reproducing means includes: 

focus setting means for making one out 
of the plurality of icons be in focus, wherein 
the monitoring means includes: s 

a determination operation detecting unit for 
detecting a determination operation per- 
formed on one out of the plurality of icons; 
a cursor move operation detecting unit for io 
detecting a cursor move operation; and 
a focus changing unit for making another 
one out of the plurality of icons be in focus 
based on the cursor move operation de- 
tected by the cursor move operation de- is 
tecting unit, wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 20 
ing unit, wherein 

the determination operation detecting unit de- 
tects a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus, wherein 2s 
the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 30 
tion, and wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on values 
weighted by the weighting means. 

35 

43. A terminal apparatus for displaying an image by re- 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 40 
ture of a moving picture and a still picture, wherein 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 45 
lated to an origin piece of image information and in- 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "1," the terminal 
apparatus including: so 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out 55 
of the m pieces of image information stored in 
the cache means; 

monitoring means for monitoring whether an 



operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means for, before the monitoring 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 ^s<m, and t is an integer sat- 
isfying 1^t<n; 

specifying means for specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means; 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation; 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed; 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information; and 

deleting means for deleting, out of the identifi- 
ers of high ranking s pieces of image informa- 
tion and t pieces of navigation information in the 
cache table, identifiers of pieces of image infor- 
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mation and pieces of navigation information 
which have been stored in the cache means, 
wherein 

the monitoring means includes: 

a determination operation detecting unit s 
for detecting a determination operation per- 
formed on one out of the plurality of icons, 
wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information io 
detected by the determination operation detect- 
ing unit, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and is 
receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion. 

44. A terminal apparatus for displaying an image by re- 20 
producing one out of m pieces of image information 
and for interactively changing the image using n 
pieces of navigation information, wherein the image 
is one of a moving picture, a still picture, and a mix- 
ture of a moving picture and a still picture, wherein ss 
the m pieces of image information and the n pieces 
of navigation information together are broadcast by 
a broadcasting station to the terminal apparatus, 
wherein each piece of navigation information is re- 
lated to an origin piece of image information and in- 30 
dicates a plurality pieces of link-target image infor- 
mation, wherein m and n are each an integer either 
of being equal to and larger than "I," the terminal 
apparatus including: 

35 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information; 
reproducing means for reproducing the one out 
of the m pieces of image information stored in 40 
the cache means; 

monitoring means for monitoring whether an 
operator has performed a certain operation re- 
sponding to the image displayed; 
receiving means for, before the monitoring 45 
means determines that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of so 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- ss 
teger satisfying 1 <s<m, and t is an integer sat- 
isfying 1<t<n; 

specifying means for specifying one out of the 



plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring means monitors that the operator has 
performed the certain operation; 
identifying means for identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified by the specifying means as one 
out the s pieces of image information stored in 
the cache means; 

first controlling means for reading the piece of 
link-target image information identified by the 
identifying means and instructing the reproduc- 
ing means to reproduce the piece of link-target 
image information, and instructing the receiving 
means to receive other s pieces of image infor- 
mation and other t pieces of navigation infor- 
mation based on one out of the t pieces of nav- 
igation information in the cache means corre- 
sponding to the piece of link-target image infor- 
mation identified by the identifying means; 
superimposing means for superimposing, 
based on a piece of navigation information cor- 
responding to the one out of the m pieces of 
image information stored in the cache means, 
a plurality of icons on the image which is dis- 
played when the reproducing means reproduc- 
es the one out of the m pieces of image infor- 
mation; 

rank setting means for setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed; 
cache table registering means for registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information; and 

rank information detecting means for detecting 
a piece of rank information from the piece of 
navigation information corresponding to the 
one out of the m pieces of image information 
reproduced by the reproducing means, wherein 
the piece of rank information includes ranks of 
the plurality pieces of link-target image informa- 
tion, wherein 

the monitoring means includes: 

a determination operation detecting unit 
for detecting a determination operation per- 
formed on one out of the plurality of icons, 
wherein 

the identifying means identifies one out of the 
plurality pieces of link-target image information 
detected by the determination operation detect- 
ing unit, wherein 

the receiving means receives the s pieces of 
image information whose identifiers are regis- 
tered by the cache table registering means and 
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receives t pieces of navigation information cor- 
responding to the s pieces of image informa- 
tion, and wherein 

the rank setting means sets ranks of the m piec- 
es of image information based on the piece of s 
rank information. 

45. A reproduction method used in a terminal apparatus 
for displaying an image by reproducing one out of 
m pieces of image information and for interactively io 
changing the image using n pieces of navigation in- 
formation wherein the image is one of a moving pic- 
ture, a still picture, and a mixture of a moving picture 
and a still picture, wherein the m pieces of image 
information and the n pieces of navigation informa- is 
tion together are broadcast by a broadcasting sta- 
tion to the terminal apparatus, wherein each piece 
of navigation information is related to an origin piece 
of image information and indicates a plurality pieces 
of link-target image information, wherein m and n 20 
are each an integer eitherof being equal to and larg- 
er than "1 ," the terminal apparatus comprising: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 2s 
the n pieces of navigation information, wherein 
the reproduction method comprising: 
a reproducing step of reproducing the one out 
of the m pieces of image information stored in 
the cache means; 30 
a monitoring step of monitoring whether an op- 
erator has performed a certain operation re- 
sponding to the image displayed; 
a receiving step of, before it is determined in 
the monitoring step that the operator has per- 35 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 40 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 ^s<m, and t is an integer sat- *s 
isfying 1 st<n; 

a specifying step of specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring step monitors that the operator has per- 50 
formed the certain operation; 
an identifying step of identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step as one out 
the s pieces of image information stored in the ss 
cache means; and 

a first controlling step of reading the piece of 
link-target image information identified in the 



identifying step and instructing the reproducing 
step to reproduce the piece of link-target image 
information, and instructing the receiving step 
to receive other s pieces of image information 
and other t pieces of navigation information 
based on one out of the t pieces of navigation 
information in the cache means corresponding 
to the piece of link-target image information 
identified in the identifying step. 

46. The reproduction method of Claim 45 further com- 
prising: 

a superimposing step of superimposing, based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
age information stored in the cache means, a 
plurality of icons on the image which is dis- 
played when the one out of the m pieces of im- 
age information is reproduced in the reproduc- 
ing step, wherein 
the monitoring step includes: 
a determination operation detecting sub-step of 
detecting a determination operation performed 
on one out of the plurality of icons, wherein 
in the identifying step, one out of the plurality 
pieces of link-target image information detect- 
ed by the determination operation detecting 
unit is identified. 

47. The reproduction method of Claim 46 further com- 
prising: 

a default image reproducing step of, when the 
identifying step fails to identify the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step, reproduc- 
ing a default image; and 
a second controlling step of instructing the re- 
ceiving step to receive the piece of link-target 
image information specified in the specifying 
step when the piece of link-target image infor- 
mation is not identified in the identifying step, 
and to receive a piece of navigation information 
corresponding to the piece of link-target image 
information specified in the specifying step, and 
storing the received piece of link-target image 
information and the corresponding piece of 
navigation information in the cache means, 
wherein 

in the superimposing step, a plurality of icons 
are superimposed on the image based on the 
piece of navigation information received in the 
receiving step. 

48. The reproduction method of Claim 46, wherein 

the reproducing step includes: 
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a focus setting step of making one out of the 
plurality of icons be in focus, wherein 
the monitoring step includes: 
a cursor move operation detecting sub-step of 
detecting a cursor move operation; and 
a focus changing sub-step of making another 
one out of the plurality of icons be in focus 
based on the cursor move operation detected 
in the cursor move operation detecting sub- 
step, wherein 

in the determination operation detecting sub- 
step, a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus is detected. 

49. The reproduction method of Claim 45 further com- 
prising: 

a rank setting step of setting ranks of the m 
pieces of image information stored in the cache 
means based on possibility of being displayed; 
and 

a cache table registering step of registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
of image information and registering identifiers 
of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information, wherein 

in the receiving step, the s pieces of image in- 
formation whose identifiers are registered in the 
cache table reqisterinq step are received and t 
pieces of navigation information corresponding 
to the s pieces of image information are re- 
ceived. 

50. The reproduction method of Claim 49 further com- 
prising: 

a weighting step of weighting, with a highest 
value, the one out of the plurality of icons made 
to be in focus in the focus setting step, and for 
weighting, with a second highest value, icons 
adjacent to the one in focus, wherein 
in the rank setting step, ranks of the m pieces 
of image information are set based on values 
weighted in the weighting step. 



51 



The reproduction method of Claim 50 further com- 
prising: 

a deleting step of deleting, out of the identifi- 
ers of high ranking s pieces of image information 
and t pieces of navigation information in the cache 
table, identifiers of pieces of image information and 
pieces of navigation information which have been 
stored in the cache means. 



52. A record medium in which a reproduction program 
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is recorded, the reproduction program being used 
in a terminal apparatus for displaying an image by 
reproducing one out of m pieces of image informa- 
tion and for interactively changing the image using 
n pieces of navigation information wherein the im- 
age is one of a moving picture, a still picture, and a 
mixture of a moving picture and a still picture, 
wherein the m pieces of image information and the 
n pieces of navigation information together are 
broadcast by a broadcasting station to the terminal 
apparatus, wherein each piece of navigation infor- 
mation is related to an origin piece of image infor- 
mation and indicates a plurality pieces of link-target 
image information, wherein m and n are each an 
integer either of being equal to and larger than "V 
the terminal apparatus comprising: 

cache means for storing a pair of one out of the 
m pieces of image information and one out of 
the n pieces of navigation information, wherein 
the reproduction program comprising: 
a reproducing step of reproducing the one out 
of the m pieces of image information stored in 
the cache means; 

a monitoring step of monitoring whether an op- 
erator has performed a certain operation re- 
sponding to the image displayed; 
a receiving step of, before it is determined in 
the monitoring step that the operator has per- 
formed the certain operation, receiving s pieces 
of image information which have possibility of 
being displayed and t pieces of navigation in- 
formation respectively related to the s pieces of 
image information based on the one out of the 
n pieces of navigation information stored in the 
cache means, and storing the s pieces of image 
information and the t pieces of navigation infor- 
mation in the cache means, wherein s is an in- 
teger satisfying 1 ^s<m, and t is an integer sat- 
isfying 1^t<n; 

a specifying step of specifying one out of the 
plurality pieces of link-target image information 
based on the certain operation when the mon- 
itoring step monitors that the operator has per- 
formed the certain operation; 
an identifying step of identifying the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step as one out 
the s pieces of image information stored in the 
cache means; and 

a first controlling step of reading the piece of 
link-target image information identified in the 
identifying step and instructing the reproducing 
step to reproduce the piece of link-target image 
information, and instructing the receiving step 
to receive other s pieces of image information 
and other t pieces of navigation information 
based on one out of the t pieces of navigation 
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information in the cache means corresponding 
to the piece of link-target image information 
identified in the identifying step. 

53. The record medium of Claim 52, wherein 

the reproduction program further comprises: 
a superimposing step of superimposing., based 
on a piece of navigation information corre- 
sponding to the one out of the m pieces of im- 
age information stored in the cache means, a 
plurality of icons on the image which is dis- 
played when the one out of the m pieces of im- 
age information is reproduced in the reproduc- 
ing step, wherein 
the monitoring step includes: 
a determination operation detecting sub-step of 
detecting a determination operation performed 
on one out of the plurality of icons, wherein 
in Ihe identifying step, one out of the plurality 
pieces of link-target image information detect- 
ed by the determination operation detecting 
unit is identified. 

54. The record medium of Claim 53, wherein 

the reproduction program further comprises: 
a default image reproducing step of, when the 
identifying step fails to identify the one out of 
the plurality pieces of link-target image informa- 
tion specified in the specifying step, reproduc- 
ing a default image; and 
a second controlling step of instructing the re- 
ceiving step to receive the piece of link-target 
image information specified in the specifying 
step when the piece of link-target image infor- 
mation is not identified in the identifying step, 
and to receive a piece of navigation information 
corresponding to the piece of link-target image 
information specified in the specifying step, and 
storing the received piece of link-target image 
information and the corresponding piece of 
navigation information in the cache means, 
wherein 

in the superimposing step, a plurality of icons 
are superimposed on the image based on the 
piece of navigation information received in the 
receiving step. 

55. The record medium of Claim 53, wherein 

the reproducing step includes: 

a focus setting step of making one out of the 

plurality of icons be in focus, wherein 

the monitoring step includes: 

a cursor move operation detecting sub-step of 

detecting a cursor move operation; and 

a focus changing sub-step of making another 



one out of the plurality of icons be in focus 
based on the cursor move operation detected 
in the cursor move operation detecting sub- 
step, wherein 

5 in the determination operation detecting sub- 

step, a determination operation performed on 
the other one out of the plurality of icons in fo- 
cus is detected. 

10 56. The record medium of Claim 52, wherein 

the reproduction program further comprises: 
a rank setting step of setting ranks of the m 
pieces of image information stored in the cache 
15 means based on possibility of being displayed; 

and 

a cache table registering step of registering 
identifiers of high ranking s pieces of image in- 
formation in a cache table, out of the m pieces 
20 of image informalion and registering identifiers 

of t pieces of navigation information corre- 
sponding to the high ranking s pieces of image 
information, wherein 

in the receiving step, the s pieces of image in- 
25 formation whose identifiers are registered in the 

cache table registering step are received and t 
pieces of navigation information corresponding 
to the s pieces of image information are re- 
ceived. 

30 

57. The record medium of Claim 56, wherein 

the reproduction program further comprises: 
a weighting step of weighting, with a highest 

35 value, the one out of the plurality of icons made 

to be in focus in the focus setting step, and for 
weighting, with a second highest value, icons 
adjacent to the one in focus, wherein 
in the rank setting step, ranks of the m pieces 

40 of image information are set based on values 

weighted in the weighting step. 

58. The record medium of Claim 57, wherein 

45 the reproduction program further comprises: 

a deleting step of deleting, out of the identifiers 
of high ranking s pieces of image information 
and t pieces of navigation information in the 
cache table, identifiers of pieces of image infor- 

50 mation and pieces of navigation information 

which have been stored in the cache means. 
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FIG. 2A 



NARRATION INCLUDED IN AUDIO ELEMENT[1] (PIP =0x0601) 



„ j _ INTRODUCING INTERACTIVE CHANNEL. 
THANK YOU FOR SELECTING THE 'A* BROADCAST. 
FOR TODAY'S BROADCAST.WE WILL BE SHOWING 
THE FOLLOWING PROGRAMS. WE ARE SURE YOU 
WILL ENJOY THEM. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT[1](PID=0X202) 

SHOT OF A BROADCASTING COMPANY ANNOUNCER(120 SECONDS) 
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FIG. 2B 



NARRATI ON INCLUDED IN AUDIO ELEMENT [2] (PIP = 0x0602) 

NEW MOVIE INFORMATION. 
COMING UP SOON AT THEATERS IN OSAKA. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT [21 (PID = 
PREVIEW OF NEW MOVIES(360 SECONDS) 
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FIG. 2C 



NARRATION INCLUDED IN AUDIO ELEMENT[12] 



COMING UP NOW HIGHLIGHTS FROM "THE TERROR 
OF THE HUGE TORNADO" (DISTRIBUTED BY AAA 
COMPANY). PLEASE SELECT YOUR DESIRED SCENE.I 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT[12] 

DIGEST VERSION OF "THE TERROR OF THE HUGE TORNADO" 
DISTRIBUTED BY A AA . COMPANYf 1 20 SECONDS) 
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FIG. 2D 



NARRATION INCLUDED IN AUDIO ELEMENT[43] 



INTRODUCING THE CAST OF "THE TERROR OF THE HUGE 
TORNADO" (DISTRIBUTED BY AAA COMPANY). 
PLEASE SELECT AN ACTOR/ACTRESS. 



MOTION PICTURE INCLUDED IN VIDEO ELEMENT[43] 

SHOTS OF THE MAIN CAST OF "THE TERROR OF THE HUGE TORNADO- 
DISTRIBUTED BY AAA COMPANY 
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FIG. 6 
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FIG. 8B 
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FIG. 10A 
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